2023-02-19 20:59:46,079 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-19 20:59:46,124 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=268, ProcessCount=167, AvailableMemoryMB=11370 2023-02-19 20:59:46,405 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d 2023-02-19 20:59:46,427 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 20:59:46,428 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/cluster_94f2c487-2a40-0be8-3e02-be44caac612f, deleteOnExit=true 2023-02-19 20:59:46,428 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 20:59:46,429 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/test.cache.data in system properties and HBase conf 2023-02-19 20:59:46,429 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 20:59:46,430 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/hadoop.log.dir in system properties and HBase conf 2023-02-19 20:59:46,430 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 20:59:46,431 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 20:59:46,431 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 20:59:46,553 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-19 20:59:46,962 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 20:59:46,967 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:59:46,967 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:59:46,968 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 20:59:46,968 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:59:46,968 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 20:59:46,968 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 20:59:46,969 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:59:46,969 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:59:46,969 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 20:59:46,970 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/nfs.dump.dir in system properties and HBase conf 2023-02-19 20:59:46,970 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/java.io.tmpdir in system properties and HBase conf 2023-02-19 20:59:46,970 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:59:46,970 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 20:59:46,971 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 20:59:47,490 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:59:47,495 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:59:47,835 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-19 20:59:48,047 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-19 20:59:48,062 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:59:48,109 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:59:48,154 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/java.io.tmpdir/Jetty_localhost_35439_hdfs____hl13mq/webapp 2023-02-19 20:59:48,318 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35439 2023-02-19 20:59:48,329 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:59:48,330 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:59:48,878 WARN [Listener at localhost/39245] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:59:48,978 WARN [Listener at localhost/39245] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:59:49,000 WARN [Listener at localhost/39245] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:59:49,007 INFO [Listener at localhost/39245] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:59:49,015 INFO [Listener at localhost/39245] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/java.io.tmpdir/Jetty_localhost_41447_datanode____.y0ld6n/webapp 2023-02-19 20:59:49,153 INFO [Listener at localhost/39245] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41447 2023-02-19 20:59:49,586 WARN [Listener at localhost/40179] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:59:49,606 WARN [Listener at localhost/40179] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:59:49,611 WARN [Listener at localhost/40179] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:59:49,613 INFO [Listener at localhost/40179] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:59:49,619 INFO [Listener at localhost/40179] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/java.io.tmpdir/Jetty_localhost_43383_datanode____.iu7cay/webapp 2023-02-19 20:59:49,765 INFO [Listener at localhost/40179] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43383 2023-02-19 20:59:49,784 WARN [Listener at localhost/38225] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:59:50,127 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x18d109932718056b: Processing first storage report for DS-74ac76f9-41d3-40d7-aa73-d6fabec6d3c7 from datanode ea3edb84-e1cd-49fc-a840-9e350ebd223c 2023-02-19 20:59:50,129 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x18d109932718056b: from storage DS-74ac76f9-41d3-40d7-aa73-d6fabec6d3c7 node DatanodeRegistration(127.0.0.1:46691, datanodeUuid=ea3edb84-e1cd-49fc-a840-9e350ebd223c, infoPort=39877, infoSecurePort=0, ipcPort=38225, storageInfo=lv=-57;cid=testClusterID;nsid=273658117;c=1676840387574), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-19 20:59:50,129 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd70415c07fa1b68: Processing first storage report for DS-ee441989-225d-4741-97a4-918ed38e4951 from datanode f65165bb-6a94-4777-a1c8-21414b415d39 2023-02-19 20:59:50,130 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd70415c07fa1b68: from storage DS-ee441989-225d-4741-97a4-918ed38e4951 node DatanodeRegistration(127.0.0.1:37279, datanodeUuid=f65165bb-6a94-4777-a1c8-21414b415d39, infoPort=35359, infoSecurePort=0, ipcPort=40179, storageInfo=lv=-57;cid=testClusterID;nsid=273658117;c=1676840387574), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-19 20:59:50,130 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x18d109932718056b: Processing first storage report for DS-5244a849-3174-4086-8f03-aad7b1bc5a57 from datanode ea3edb84-e1cd-49fc-a840-9e350ebd223c 2023-02-19 20:59:50,130 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x18d109932718056b: from storage DS-5244a849-3174-4086-8f03-aad7b1bc5a57 node DatanodeRegistration(127.0.0.1:46691, datanodeUuid=ea3edb84-e1cd-49fc-a840-9e350ebd223c, infoPort=39877, infoSecurePort=0, ipcPort=38225, storageInfo=lv=-57;cid=testClusterID;nsid=273658117;c=1676840387574), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:59:50,130 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd70415c07fa1b68: Processing first storage report for DS-522646e1-551e-425b-95a4-61f1dc7727a0 from datanode f65165bb-6a94-4777-a1c8-21414b415d39 2023-02-19 20:59:50,130 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd70415c07fa1b68: from storage DS-522646e1-551e-425b-95a4-61f1dc7727a0 node DatanodeRegistration(127.0.0.1:37279, datanodeUuid=f65165bb-6a94-4777-a1c8-21414b415d39, infoPort=35359, infoSecurePort=0, ipcPort=40179, storageInfo=lv=-57;cid=testClusterID;nsid=273658117;c=1676840387574), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:59:50,285 DEBUG [Listener at localhost/38225] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d 2023-02-19 20:59:50,390 INFO [Listener at localhost/38225] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/cluster_94f2c487-2a40-0be8-3e02-be44caac612f/zookeeper_0, clientPort=50373, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/cluster_94f2c487-2a40-0be8-3e02-be44caac612f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/cluster_94f2c487-2a40-0be8-3e02-be44caac612f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 20:59:50,411 INFO [Listener at localhost/38225] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50373 2023-02-19 20:59:50,423 INFO [Listener at localhost/38225] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:59:50,426 INFO [Listener at localhost/38225] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:59:51,128 INFO [Listener at localhost/38225] util.FSUtils(479): Created version file at hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53 with version=8 2023-02-19 20:59:51,129 INFO [Listener at localhost/38225] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:59:51,131 INFO [Listener at localhost/38225] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:59:51,136 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/hbase-staging 2023-02-19 20:59:51,453 INFO [Listener at localhost/38225] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-19 20:59:51,931 INFO [Listener at localhost/38225] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:59:51,963 INFO [Listener at localhost/38225] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:59:51,964 INFO [Listener at localhost/38225] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:59:51,964 INFO [Listener at localhost/38225] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:59:51,964 INFO [Listener at localhost/38225] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:59:51,965 INFO [Listener at localhost/38225] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:59:52,105 INFO [Listener at localhost/38225] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:59:52,183 DEBUG [Listener at localhost/38225] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-19 20:59:52,280 INFO [Listener at localhost/38225] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40927 2023-02-19 20:59:52,290 INFO [Listener at localhost/38225] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:59:52,292 INFO [Listener at localhost/38225] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:59:52,314 INFO [Listener at localhost/38225] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40927 connecting to ZooKeeper ensemble=127.0.0.1:50373 2023-02-19 20:59:52,366 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:409270x0, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:59:52,369 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40927-0x1006e61b8a40000 connected 2023-02-19 20:59:52,402 DEBUG [Listener at localhost/38225] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:59:52,402 DEBUG [Listener at localhost/38225] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:59:52,406 DEBUG [Listener at localhost/38225] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:59:52,414 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40927 2023-02-19 20:59:52,414 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40927 2023-02-19 20:59:52,414 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40927 2023-02-19 20:59:52,415 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40927 2023-02-19 20:59:52,415 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40927 2023-02-19 20:59:52,424 INFO [Listener at localhost/38225] master.HMaster(444): hbase.rootdir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53, hbase.cluster.distributed=false 2023-02-19 20:59:52,492 INFO [Listener at localhost/38225] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:59:52,493 INFO [Listener at localhost/38225] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:59:52,493 INFO [Listener at localhost/38225] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:59:52,493 INFO [Listener at localhost/38225] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:59:52,493 INFO [Listener at localhost/38225] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:59:52,493 INFO [Listener at localhost/38225] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:59:52,498 INFO [Listener at localhost/38225] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:59:52,501 INFO [Listener at localhost/38225] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44193 2023-02-19 20:59:52,503 INFO [Listener at localhost/38225] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:59:52,510 DEBUG [Listener at localhost/38225] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:59:52,511 INFO [Listener at localhost/38225] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:59:52,513 INFO [Listener at localhost/38225] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:59:52,516 INFO [Listener at localhost/38225] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44193 connecting to ZooKeeper ensemble=127.0.0.1:50373 2023-02-19 20:59:52,520 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:441930x0, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:59:52,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44193-0x1006e61b8a40001 connected 2023-02-19 20:59:52,521 DEBUG [Listener at localhost/38225] zookeeper.ZKUtil(164): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:59:52,522 DEBUG [Listener at localhost/38225] zookeeper.ZKUtil(164): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:59:52,523 DEBUG [Listener at localhost/38225] zookeeper.ZKUtil(164): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:59:52,524 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44193 2023-02-19 20:59:52,527 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44193 2023-02-19 20:59:52,527 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44193 2023-02-19 20:59:52,527 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44193 2023-02-19 20:59:52,528 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44193 2023-02-19 20:59:52,540 INFO [Listener at localhost/38225] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:59:52,540 INFO [Listener at localhost/38225] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:59:52,540 INFO [Listener at localhost/38225] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:59:52,541 INFO [Listener at localhost/38225] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:59:52,541 INFO [Listener at localhost/38225] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:59:52,541 INFO [Listener at localhost/38225] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:59:52,541 INFO [Listener at localhost/38225] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:59:52,543 INFO [Listener at localhost/38225] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40243 2023-02-19 20:59:52,543 INFO [Listener at localhost/38225] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:59:52,544 DEBUG [Listener at localhost/38225] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:59:52,545 INFO [Listener at localhost/38225] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:59:52,547 INFO [Listener at localhost/38225] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:59:52,549 INFO [Listener at localhost/38225] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40243 connecting to ZooKeeper ensemble=127.0.0.1:50373 2023-02-19 20:59:52,554 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:402430x0, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:59:52,555 DEBUG [Listener at localhost/38225] zookeeper.ZKUtil(164): regionserver:402430x0, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:59:52,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40243-0x1006e61b8a40002 connected 2023-02-19 20:59:52,556 DEBUG [Listener at localhost/38225] zookeeper.ZKUtil(164): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:59:52,557 DEBUG [Listener at localhost/38225] zookeeper.ZKUtil(164): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:59:52,560 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40243 2023-02-19 20:59:52,560 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40243 2023-02-19 20:59:52,561 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40243 2023-02-19 20:59:52,564 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40243 2023-02-19 20:59:52,564 DEBUG [Listener at localhost/38225] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40243 2023-02-19 20:59:52,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40927,1676840391295 2023-02-19 20:59:52,577 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:59:52,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40927,1676840391295 2023-02-19 20:59:52,598 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:59:52,598 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:59:52,598 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:59:52,598 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:59:52,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:59:52,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40927,1676840391295 from backup master directory 2023-02-19 20:59:52,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:59:52,604 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40927,1676840391295 2023-02-19 20:59:52,604 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:59:52,605 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:59:52,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40927,1676840391295 2023-02-19 20:59:52,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-19 20:59:52,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-19 20:59:52,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/hbase.id with ID: 60fb2ec1-38dc-4444-a1b9-a084e06abe75 2023-02-19 20:59:52,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:59:52,761 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:59:52,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x00bc10b2 to 127.0.0.1:50373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:59:52,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34d9121e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:59:52,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:59:52,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 20:59:52,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-19 20:59:52,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-19 20:59:52,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-19 20:59:52,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-19 20:59:52,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:59:52,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/data/master/store-tmp 2023-02-19 20:59:52,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:52,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:59:52,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:59:52,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:59:52,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:59:52,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:59:52,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:59:52,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:59:52,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/WALs/jenkins-hbase4.apache.org,40927,1676840391295 2023-02-19 20:59:52,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40927%2C1676840391295, suffix=, logDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/WALs/jenkins-hbase4.apache.org,40927,1676840391295, archiveDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/oldWALs, maxLogs=10 2023-02-19 20:59:53,050 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46691,DS-74ac76f9-41d3-40d7-aa73-d6fabec6d3c7,DISK] 2023-02-19 20:59:53,050 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37279,DS-ee441989-225d-4741-97a4-918ed38e4951,DISK] 2023-02-19 20:59:53,058 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-19 20:59:53,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/WALs/jenkins-hbase4.apache.org,40927,1676840391295/jenkins-hbase4.apache.org%2C40927%2C1676840391295.1676840393002 2023-02-19 20:59:53,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37279,DS-ee441989-225d-4741-97a4-918ed38e4951,DISK], DatanodeInfoWithStorage[127.0.0.1:46691,DS-74ac76f9-41d3-40d7-aa73-d6fabec6d3c7,DISK]] 2023-02-19 20:59:53,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:59:53,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:53,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:59:53,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:59:53,198 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:59:53,206 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 20:59:53,245 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 20:59:53,260 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:53,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:59:53,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:59:53,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:59:53,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:53,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74394085, jitterRate=0.10855825245380402}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:59:53,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:59:53,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 20:59:53,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 20:59:53,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 20:59:53,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 20:59:53,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-19 20:59:53,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 39 msec 2023-02-19 20:59:53,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 20:59:53,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 20:59:53,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 20:59:53,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 20:59:53,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 20:59:53,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 20:59:53,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 20:59:53,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 20:59:53,447 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:59:53,448 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 20:59:53,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 20:59:53,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 20:59:53,466 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:59:53,466 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:59:53,466 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:59:53,466 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:59:53,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40927,1676840391295, sessionid=0x1006e61b8a40000, setting cluster-up flag (Was=false) 2023-02-19 20:59:53,489 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:59:53,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 20:59:53,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40927,1676840391295 2023-02-19 20:59:53,502 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:59:53,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 20:59:53,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40927,1676840391295 2023-02-19 20:59:53,513 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.hbase-snapshot/.tmp 2023-02-19 20:59:53,569 INFO [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(952): ClusterId : 60fb2ec1-38dc-4444-a1b9-a084e06abe75 2023-02-19 20:59:53,569 INFO [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(952): ClusterId : 60fb2ec1-38dc-4444-a1b9-a084e06abe75 2023-02-19 20:59:53,575 DEBUG [RS:1;jenkins-hbase4:40243] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:59:53,575 DEBUG [RS:0;jenkins-hbase4:44193] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:59:53,582 DEBUG [RS:1;jenkins-hbase4:40243] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:59:53,582 DEBUG [RS:0;jenkins-hbase4:44193] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:59:53,582 DEBUG [RS:1;jenkins-hbase4:40243] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:59:53,582 DEBUG [RS:0;jenkins-hbase4:44193] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:59:53,587 DEBUG [RS:1;jenkins-hbase4:40243] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:59:53,587 DEBUG [RS:0;jenkins-hbase4:44193] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:59:53,588 DEBUG [RS:1;jenkins-hbase4:40243] zookeeper.ReadOnlyZKClient(139): Connect 0x52e07816 to 127.0.0.1:50373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:59:53,589 DEBUG [RS:0;jenkins-hbase4:44193] zookeeper.ReadOnlyZKClient(139): Connect 0x0e97d46e to 127.0.0.1:50373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:59:53,597 DEBUG [RS:1;jenkins-hbase4:40243] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c279c3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:59:53,598 DEBUG [RS:0;jenkins-hbase4:44193] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@502bcc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:59:53,598 DEBUG [RS:1;jenkins-hbase4:40243] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58181366, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:59:53,598 DEBUG [RS:0;jenkins-hbase4:44193] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46fbf1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:59:53,625 DEBUG [RS:1;jenkins-hbase4:40243] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40243 2023-02-19 20:59:53,626 DEBUG [RS:0;jenkins-hbase4:44193] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44193 2023-02-19 20:59:53,632 INFO [RS:1;jenkins-hbase4:40243] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:59:53,632 INFO [RS:0;jenkins-hbase4:44193] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:59:53,632 INFO [RS:1;jenkins-hbase4:40243] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:59:53,632 INFO [RS:0;jenkins-hbase4:44193] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:59:53,632 DEBUG [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:59:53,632 DEBUG [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:59:53,635 INFO [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40927,1676840391295 with isa=jenkins-hbase4.apache.org/172.31.14.131:44193, startcode=1676840392492 2023-02-19 20:59:53,635 INFO [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40927,1676840391295 with isa=jenkins-hbase4.apache.org/172.31.14.131:40243, startcode=1676840392539 2023-02-19 20:59:53,655 DEBUG [RS:1;jenkins-hbase4:40243] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:59:53,655 DEBUG [RS:0;jenkins-hbase4:44193] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:59:53,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 20:59:53,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:59:53,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:59:53,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:59:53,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:59:53,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 20:59:53,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:53,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:59:53,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:53,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676840423701 2023-02-19 20:59:53,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 20:59:53,707 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:59:53,707 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 20:59:53,713 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:59:53,714 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49571, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:59:53,714 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57123, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:59:53,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 20:59:53,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 20:59:53,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 20:59:53,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 20:59:53,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40927] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 20:59:53,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 20:59:53,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 20:59:53,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:53,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 20:59:53,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 20:59:53,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 20:59:53,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 20:59:53,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 20:59:53,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840393738,5,FailOnTimeoutGroup] 2023-02-19 20:59:53,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840393740,5,FailOnTimeoutGroup] 2023-02-19 20:59:53,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:53,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 20:59:53,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:53,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:53,760 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:59:53,761 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:59:53,761 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53 2023-02-19 20:59:53,765 DEBUG [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(2829): Master is not running yet 2023-02-19 20:59:53,765 DEBUG [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(2829): Master is not running yet 2023-02-19 20:59:53,766 WARN [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-19 20:59:53,766 WARN [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-19 20:59:53,779 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:53,782 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:59:53,784 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/info 2023-02-19 20:59:53,785 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:59:53,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:53,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:59:53,789 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:59:53,790 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:59:53,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:53,791 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:59:53,793 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/table 2023-02-19 20:59:53,793 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:59:53,794 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:53,795 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740 2023-02-19 20:59:53,796 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740 2023-02-19 20:59:53,800 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:59:53,801 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:59:53,805 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:53,807 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61001300, jitterRate=-0.09100979566574097}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:59:53,807 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:59:53,807 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:59:53,807 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:59:53,807 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:59:53,807 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:59:53,807 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:59:53,808 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:59:53,808 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:59:53,815 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:59:53,815 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 20:59:53,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 20:59:53,837 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 20:59:53,839 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 20:59:53,990 WARN [jenkins-hbase4:40927] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-19 20:59:54,767 INFO [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40927,1676840391295 with isa=jenkins-hbase4.apache.org/172.31.14.131:44193, startcode=1676840392492 2023-02-19 20:59:54,767 INFO [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40927,1676840391295 with isa=jenkins-hbase4.apache.org/172.31.14.131:40243, startcode=1676840392539 2023-02-19 20:59:54,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40927] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:54,774 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:54,781 DEBUG [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53 2023-02-19 20:59:54,781 DEBUG [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53 2023-02-19 20:59:54,781 DEBUG [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39245 2023-02-19 20:59:54,781 DEBUG [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39245 2023-02-19 20:59:54,781 DEBUG [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:59:54,781 DEBUG [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:59:54,791 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:59:54,791 DEBUG [RS:0;jenkins-hbase4:44193] zookeeper.ZKUtil(162): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:54,791 DEBUG [RS:1;jenkins-hbase4:40243] zookeeper.ZKUtil(162): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:54,791 WARN [RS:0;jenkins-hbase4:44193] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:59:54,791 WARN [RS:1;jenkins-hbase4:40243] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:59:54,792 INFO [RS:0;jenkins-hbase4:44193] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:59:54,792 INFO [RS:1;jenkins-hbase4:40243] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:59:54,793 DEBUG [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/WALs/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:54,793 DEBUG [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/WALs/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:54,793 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44193,1676840392492] 2023-02-19 20:59:54,793 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40243,1676840392539] 2023-02-19 20:59:54,803 DEBUG [RS:1;jenkins-hbase4:40243] zookeeper.ZKUtil(162): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:54,803 DEBUG [RS:0;jenkins-hbase4:44193] zookeeper.ZKUtil(162): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:54,804 DEBUG [RS:1;jenkins-hbase4:40243] zookeeper.ZKUtil(162): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:54,804 DEBUG [RS:0;jenkins-hbase4:44193] zookeeper.ZKUtil(162): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:54,815 DEBUG [RS:1;jenkins-hbase4:40243] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:59:54,815 DEBUG [RS:0;jenkins-hbase4:44193] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:59:54,825 INFO [RS:0;jenkins-hbase4:44193] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:59:54,825 INFO [RS:1;jenkins-hbase4:40243] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:59:54,847 INFO [RS:0;jenkins-hbase4:44193] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:59:54,847 INFO [RS:1;jenkins-hbase4:40243] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:59:54,852 INFO [RS:1;jenkins-hbase4:40243] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:59:54,852 INFO [RS:0;jenkins-hbase4:44193] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:59:54,852 INFO [RS:1;jenkins-hbase4:40243] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:54,853 INFO [RS:0;jenkins-hbase4:44193] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:54,853 INFO [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:59:54,853 INFO [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:59:54,862 INFO [RS:0;jenkins-hbase4:44193] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:54,862 INFO [RS:1;jenkins-hbase4:40243] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:54,862 DEBUG [RS:0;jenkins-hbase4:44193] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,862 DEBUG [RS:1;jenkins-hbase4:40243] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,863 DEBUG [RS:0;jenkins-hbase4:44193] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,863 DEBUG [RS:1;jenkins-hbase4:40243] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,863 DEBUG [RS:0;jenkins-hbase4:44193] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,863 DEBUG [RS:1;jenkins-hbase4:40243] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,863 DEBUG [RS:0;jenkins-hbase4:44193] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,863 DEBUG [RS:1;jenkins-hbase4:40243] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,863 DEBUG [RS:0;jenkins-hbase4:44193] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,863 DEBUG [RS:1;jenkins-hbase4:40243] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,863 DEBUG [RS:0;jenkins-hbase4:44193] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:59:54,863 DEBUG [RS:1;jenkins-hbase4:40243] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:59:54,863 DEBUG [RS:0;jenkins-hbase4:44193] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,864 DEBUG [RS:1;jenkins-hbase4:40243] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,864 DEBUG [RS:0;jenkins-hbase4:44193] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,864 DEBUG [RS:1;jenkins-hbase4:40243] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,864 DEBUG [RS:0;jenkins-hbase4:44193] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,864 DEBUG [RS:1;jenkins-hbase4:40243] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,864 DEBUG [RS:0;jenkins-hbase4:44193] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,864 DEBUG [RS:1;jenkins-hbase4:40243] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:59:54,865 INFO [RS:1;jenkins-hbase4:40243] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:54,865 INFO [RS:0;jenkins-hbase4:44193] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:54,866 INFO [RS:1;jenkins-hbase4:40243] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:54,866 INFO [RS:0;jenkins-hbase4:44193] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:54,866 INFO [RS:1;jenkins-hbase4:40243] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:54,866 INFO [RS:0;jenkins-hbase4:44193] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:54,890 INFO [RS:1;jenkins-hbase4:40243] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:59:54,890 INFO [RS:0;jenkins-hbase4:44193] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:59:54,894 INFO [RS:1;jenkins-hbase4:40243] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40243,1676840392539-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:54,894 INFO [RS:0;jenkins-hbase4:44193] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44193,1676840392492-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:54,913 INFO [RS:1;jenkins-hbase4:40243] regionserver.Replication(203): jenkins-hbase4.apache.org,40243,1676840392539 started 2023-02-19 20:59:54,913 INFO [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40243,1676840392539, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40243, sessionid=0x1006e61b8a40002 2023-02-19 20:59:54,914 INFO [RS:0;jenkins-hbase4:44193] regionserver.Replication(203): jenkins-hbase4.apache.org,44193,1676840392492 started 2023-02-19 20:59:54,914 DEBUG [RS:1;jenkins-hbase4:40243] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:59:54,914 INFO [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44193,1676840392492, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44193, sessionid=0x1006e61b8a40001 2023-02-19 20:59:54,915 DEBUG [RS:1;jenkins-hbase4:40243] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:54,915 DEBUG [RS:1;jenkins-hbase4:40243] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40243,1676840392539' 2023-02-19 20:59:54,915 DEBUG [RS:0;jenkins-hbase4:44193] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:59:54,915 DEBUG [RS:1;jenkins-hbase4:40243] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:59:54,915 DEBUG [RS:0;jenkins-hbase4:44193] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:54,916 DEBUG [RS:0;jenkins-hbase4:44193] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44193,1676840392492' 2023-02-19 20:59:54,916 DEBUG [RS:0;jenkins-hbase4:44193] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:59:54,917 DEBUG [RS:1;jenkins-hbase4:40243] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:59:54,917 DEBUG [RS:0;jenkins-hbase4:44193] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:59:54,917 DEBUG [RS:1;jenkins-hbase4:40243] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:59:54,917 DEBUG [RS:0;jenkins-hbase4:44193] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:59:54,917 DEBUG [RS:1;jenkins-hbase4:40243] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:59:54,917 DEBUG [RS:0;jenkins-hbase4:44193] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:59:54,918 DEBUG [RS:1;jenkins-hbase4:40243] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:54,918 DEBUG [RS:0;jenkins-hbase4:44193] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:54,918 DEBUG [RS:1;jenkins-hbase4:40243] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40243,1676840392539' 2023-02-19 20:59:54,918 DEBUG [RS:1;jenkins-hbase4:40243] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:59:54,918 DEBUG [RS:0;jenkins-hbase4:44193] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44193,1676840392492' 2023-02-19 20:59:54,918 DEBUG [RS:0;jenkins-hbase4:44193] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:59:54,919 DEBUG [RS:1;jenkins-hbase4:40243] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:59:54,919 DEBUG [RS:0;jenkins-hbase4:44193] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:59:54,919 DEBUG [RS:1;jenkins-hbase4:40243] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:59:54,919 INFO [RS:1;jenkins-hbase4:40243] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:59:54,920 DEBUG [RS:0;jenkins-hbase4:44193] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:59:54,920 INFO [RS:1;jenkins-hbase4:40243] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:59:54,920 INFO [RS:0;jenkins-hbase4:44193] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:59:54,920 INFO [RS:0;jenkins-hbase4:44193] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:59:54,992 DEBUG [jenkins-hbase4:40927] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 20:59:54,996 DEBUG [jenkins-hbase4:40927] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:59:55,002 DEBUG [jenkins-hbase4:40927] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:59:55,002 DEBUG [jenkins-hbase4:40927] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:59:55,003 DEBUG [jenkins-hbase4:40927] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:59:55,005 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40243,1676840392539, state=OPENING 2023-02-19 20:59:55,013 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 20:59:55,014 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:59:55,015 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:59:55,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40243,1676840392539}] 2023-02-19 20:59:55,205 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:55,207 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:59:55,210 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49562, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:59:55,224 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 20:59:55,225 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:59:55,229 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40243%2C1676840392539.meta, suffix=.meta, logDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/WALs/jenkins-hbase4.apache.org,40243,1676840392539, archiveDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/oldWALs, maxLogs=32 2023-02-19 20:59:55,250 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46691,DS-74ac76f9-41d3-40d7-aa73-d6fabec6d3c7,DISK] 2023-02-19 20:59:55,250 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37279,DS-ee441989-225d-4741-97a4-918ed38e4951,DISK] 2023-02-19 20:59:55,255 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/WALs/jenkins-hbase4.apache.org,40243,1676840392539/jenkins-hbase4.apache.org%2C40243%2C1676840392539.meta.1676840395232.meta 2023-02-19 20:59:55,255 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46691,DS-74ac76f9-41d3-40d7-aa73-d6fabec6d3c7,DISK], DatanodeInfoWithStorage[127.0.0.1:37279,DS-ee441989-225d-4741-97a4-918ed38e4951,DISK]] 2023-02-19 20:59:55,255 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:59:55,257 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 20:59:55,275 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 20:59:55,280 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 20:59:55,286 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 20:59:55,286 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:55,286 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 20:59:55,286 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 20:59:55,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:59:55,291 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/info 2023-02-19 20:59:55,291 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/info 2023-02-19 20:59:55,292 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:59:55,292 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:55,293 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:59:55,294 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:59:55,294 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:59:55,295 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:59:55,296 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:55,296 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:59:55,297 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/table 2023-02-19 20:59:55,298 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/table 2023-02-19 20:59:55,298 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:59:55,299 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:55,301 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740 2023-02-19 20:59:55,304 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740 2023-02-19 20:59:55,308 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:59:55,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:59:55,312 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64755680, jitterRate=-0.0350651741027832}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:59:55,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:59:55,326 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676840395196 2023-02-19 20:59:55,347 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 20:59:55,348 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 20:59:55,349 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40243,1676840392539, state=OPEN 2023-02-19 20:59:55,352 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 20:59:55,352 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:59:55,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 20:59:55,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40243,1676840392539 in 333 msec 2023-02-19 20:59:55,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 20:59:55,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5320 sec 2023-02-19 20:59:55,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.7810 sec 2023-02-19 20:59:55,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676840395367, completionTime=-1 2023-02-19 20:59:55,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 20:59:55,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 20:59:55,437 DEBUG [hconnection-0x5bf282f0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:59:55,439 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49564, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:59:55,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 20:59:55,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676840455457 2023-02-19 20:59:55,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676840515457 2023-02-19 20:59:55,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 89 msec 2023-02-19 20:59:55,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40927,1676840391295-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:55,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40927,1676840391295-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:55,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40927,1676840391295-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:55,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40927, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:55,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 20:59:55,490 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 20:59:55,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 20:59:55,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:59:55,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 20:59:55,512 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:59:55,515 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:59:55,536 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b 2023-02-19 20:59:55,538 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b empty. 2023-02-19 20:59:55,539 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b 2023-02-19 20:59:55,539 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 20:59:55,566 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 20:59:55,569 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0d1379743a81dc7c6cf58d2a42b2489b, NAME => 'hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp 2023-02-19 20:59:55,590 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:55,590 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 0d1379743a81dc7c6cf58d2a42b2489b, disabling compactions & flushes 2023-02-19 20:59:55,590 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. 2023-02-19 20:59:55,590 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. 2023-02-19 20:59:55,590 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. after waiting 0 ms 2023-02-19 20:59:55,590 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. 2023-02-19 20:59:55,590 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. 2023-02-19 20:59:55,591 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 0d1379743a81dc7c6cf58d2a42b2489b: 2023-02-19 20:59:55,596 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:59:55,619 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840395599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840395599"}]},"ts":"1676840395599"} 2023-02-19 20:59:55,646 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 20:59:55,648 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:59:55,653 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840395648"}]},"ts":"1676840395648"} 2023-02-19 20:59:55,661 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 20:59:55,665 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:59:55,667 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:59:55,667 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:59:55,667 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:59:55,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0d1379743a81dc7c6cf58d2a42b2489b, ASSIGN}] 2023-02-19 20:59:55,675 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0d1379743a81dc7c6cf58d2a42b2489b, ASSIGN 2023-02-19 20:59:55,680 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0d1379743a81dc7c6cf58d2a42b2489b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44193,1676840392492; forceNewPlan=false, retain=false 2023-02-19 20:59:55,833 INFO [jenkins-hbase4:40927] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 20:59:55,834 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0d1379743a81dc7c6cf58d2a42b2489b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:55,834 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840395833"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840395833"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840395833"}]},"ts":"1676840395833"} 2023-02-19 20:59:55,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0d1379743a81dc7c6cf58d2a42b2489b, server=jenkins-hbase4.apache.org,44193,1676840392492}] 2023-02-19 20:59:55,931 INFO [RS:0;jenkins-hbase4:44193] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44193%2C1676840392492, suffix=, logDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/WALs/jenkins-hbase4.apache.org,44193,1676840392492, archiveDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/oldWALs, maxLogs=32 2023-02-19 20:59:55,932 INFO [RS:1;jenkins-hbase4:40243] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40243%2C1676840392539, suffix=, logDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/WALs/jenkins-hbase4.apache.org,40243,1676840392539, archiveDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/oldWALs, maxLogs=32 2023-02-19 20:59:55,952 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37279,DS-ee441989-225d-4741-97a4-918ed38e4951,DISK] 2023-02-19 20:59:55,952 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46691,DS-74ac76f9-41d3-40d7-aa73-d6fabec6d3c7,DISK] 2023-02-19 20:59:55,957 INFO [RS:0;jenkins-hbase4:44193] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/WALs/jenkins-hbase4.apache.org,44193,1676840392492/jenkins-hbase4.apache.org%2C44193%2C1676840392492.1676840395933 2023-02-19 20:59:55,957 DEBUG [RS:0;jenkins-hbase4:44193] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46691,DS-74ac76f9-41d3-40d7-aa73-d6fabec6d3c7,DISK], DatanodeInfoWithStorage[127.0.0.1:37279,DS-ee441989-225d-4741-97a4-918ed38e4951,DISK]] 2023-02-19 20:59:55,960 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46691,DS-74ac76f9-41d3-40d7-aa73-d6fabec6d3c7,DISK] 2023-02-19 20:59:55,960 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37279,DS-ee441989-225d-4741-97a4-918ed38e4951,DISK] 2023-02-19 20:59:55,969 INFO [RS:1;jenkins-hbase4:40243] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/WALs/jenkins-hbase4.apache.org,40243,1676840392539/jenkins-hbase4.apache.org%2C40243%2C1676840392539.1676840395934 2023-02-19 20:59:55,971 DEBUG [RS:1;jenkins-hbase4:40243] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46691,DS-74ac76f9-41d3-40d7-aa73-d6fabec6d3c7,DISK], DatanodeInfoWithStorage[127.0.0.1:37279,DS-ee441989-225d-4741-97a4-918ed38e4951,DISK]] 2023-02-19 20:59:55,994 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:55,994 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:59:55,997 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:59:56,008 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. 2023-02-19 20:59:56,009 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0d1379743a81dc7c6cf58d2a42b2489b, NAME => 'hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:59:56,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0d1379743a81dc7c6cf58d2a42b2489b 2023-02-19 20:59:56,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:56,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0d1379743a81dc7c6cf58d2a42b2489b 2023-02-19 20:59:56,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0d1379743a81dc7c6cf58d2a42b2489b 2023-02-19 20:59:56,013 INFO [StoreOpener-0d1379743a81dc7c6cf58d2a42b2489b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0d1379743a81dc7c6cf58d2a42b2489b 2023-02-19 20:59:56,016 DEBUG [StoreOpener-0d1379743a81dc7c6cf58d2a42b2489b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b/info 2023-02-19 20:59:56,016 DEBUG [StoreOpener-0d1379743a81dc7c6cf58d2a42b2489b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b/info 2023-02-19 20:59:56,017 INFO [StoreOpener-0d1379743a81dc7c6cf58d2a42b2489b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d1379743a81dc7c6cf58d2a42b2489b columnFamilyName info 2023-02-19 20:59:56,018 INFO [StoreOpener-0d1379743a81dc7c6cf58d2a42b2489b-1] regionserver.HStore(310): Store=0d1379743a81dc7c6cf58d2a42b2489b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:56,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b 2023-02-19 20:59:56,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b 2023-02-19 20:59:56,028 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0d1379743a81dc7c6cf58d2a42b2489b 2023-02-19 20:59:56,032 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:56,033 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0d1379743a81dc7c6cf58d2a42b2489b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71521673, jitterRate=0.06575597822666168}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:59:56,033 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0d1379743a81dc7c6cf58d2a42b2489b: 2023-02-19 20:59:56,036 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b., pid=6, masterSystemTime=1676840395994 2023-02-19 20:59:56,044 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. 2023-02-19 20:59:56,044 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. 2023-02-19 20:59:56,046 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0d1379743a81dc7c6cf58d2a42b2489b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:56,046 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840396045"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840396045"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840396045"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840396045"}]},"ts":"1676840396045"} 2023-02-19 20:59:56,055 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 20:59:56,056 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0d1379743a81dc7c6cf58d2a42b2489b, server=jenkins-hbase4.apache.org,44193,1676840392492 in 212 msec 2023-02-19 20:59:56,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 20:59:56,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0d1379743a81dc7c6cf58d2a42b2489b, ASSIGN in 385 msec 2023-02-19 20:59:56,062 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:59:56,062 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840396062"}]},"ts":"1676840396062"} 2023-02-19 20:59:56,065 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 20:59:56,071 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:59:56,074 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 570 msec 2023-02-19 20:59:56,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 20:59:56,114 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:59:56,114 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:59:56,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:59:56,142 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43906, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:59:56,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 20:59:56,177 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:59:56,183 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-02-19 20:59:56,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 20:59:56,204 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:59:56,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-02-19 20:59:56,217 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 20:59:56,223 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 20:59:56,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.620sec 2023-02-19 20:59:56,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 20:59:56,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 20:59:56,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 20:59:56,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40927,1676840391295-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 20:59:56,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40927,1676840391295-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 20:59:56,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 20:59:56,276 DEBUG [Listener at localhost/38225] zookeeper.ReadOnlyZKClient(139): Connect 0x682ed554 to 127.0.0.1:50373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:59:56,281 DEBUG [Listener at localhost/38225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d6910f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:59:56,339 DEBUG [hconnection-0x3cc35720-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:59:56,352 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49580, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:59:56,363 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40927,1676840391295 2023-02-19 20:59:56,364 DEBUG [Listener at localhost/38225] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 20:59:56,375 DEBUG [Listener at localhost/38225] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 20:59:56,378 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43534, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 20:59:56,385 INFO [Listener at localhost/38225] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 20:59:56,392 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 20:59:56,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 20:59:56,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:43534 deadline: 1676840456390, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-19 20:59:56,394 INFO [Listener at localhost/38225] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-19 20:59:56,407 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:59:56,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-19 20:59:56,412 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:59:56,451 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:59:56,452 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-19 20:59:56,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:59:56,475 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414 2023-02-19 20:59:56,475 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f 2023-02-19 20:59:56,476 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e 2023-02-19 20:59:56,476 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 20:59:56,476 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef 2023-02-19 20:59:56,476 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30 2023-02-19 20:59:56,476 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185 2023-02-19 20:59:56,477 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414 empty. 2023-02-19 20:59:56,476 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 20:59:56,479 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e empty. 2023-02-19 20:59:56,479 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef empty. 2023-02-19 20:59:56,479 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414 2023-02-19 20:59:56,479 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4 empty. 2023-02-19 20:59:56,479 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185 empty. 2023-02-19 20:59:56,479 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446 empty. 2023-02-19 20:59:56,479 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 20:59:56,480 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30 empty. 2023-02-19 20:59:56,480 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e 2023-02-19 20:59:56,480 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3 2023-02-19 20:59:56,481 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 20:59:56,481 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185 2023-02-19 20:59:56,480 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef 2023-02-19 20:59:56,480 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 20:59:56,481 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30 2023-02-19 20:59:56,481 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3 empty. 2023-02-19 20:59:56,481 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d empty. 2023-02-19 20:59:56,482 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3 2023-02-19 20:59:56,482 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 20:59:56,482 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f empty. 2023-02-19 20:59:56,484 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f 2023-02-19 20:59:56,484 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 20:59:56,505 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-19 20:59:56,507 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 94a2c01c5633d7fdb30d081febbedbf4, NAME => 'testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp 2023-02-19 20:59:56,508 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8630f5270002fcda4479e320d28f766f, NAME => 'testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp 2023-02-19 20:59:56,508 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c5a77ef914048739ee7a1009051b5414, NAME => 'testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp 2023-02-19 20:59:56,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:56,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c5a77ef914048739ee7a1009051b5414, disabling compactions & flushes 2023-02-19 20:59:56,565 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 20:59:56,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 20:59:56,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. after waiting 0 ms 2023-02-19 20:59:56,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 20:59:56,565 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 20:59:56,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c5a77ef914048739ee7a1009051b5414: 2023-02-19 20:59:56,566 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9e298d453970c11026570bf2ed2b600e, NAME => 'testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp 2023-02-19 20:59:56,566 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:56,567 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 94a2c01c5633d7fdb30d081febbedbf4, disabling compactions & flushes 2023-02-19 20:59:56,567 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 20:59:56,567 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 20:59:56,567 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. after waiting 0 ms 2023-02-19 20:59:56,567 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 20:59:56,567 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 20:59:56,567 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 94a2c01c5633d7fdb30d081febbedbf4: 2023-02-19 20:59:56,567 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6e7da067f4df0f176a8f374fed05da30, NAME => 'testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp 2023-02-19 20:59:56,568 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:56,568 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 8630f5270002fcda4479e320d28f766f, disabling compactions & flushes 2023-02-19 20:59:56,568 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 20:59:56,568 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 20:59:56,568 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. after waiting 0 ms 2023-02-19 20:59:56,568 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 20:59:56,568 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 20:59:56,568 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 8630f5270002fcda4479e320d28f766f: 2023-02-19 20:59:56,569 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8041dbf00f4076cea8295fd209618185, NAME => 'testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp 2023-02-19 20:59:56,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:59:56,598 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:56,599 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 9e298d453970c11026570bf2ed2b600e, disabling compactions & flushes 2023-02-19 20:59:56,599 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 20:59:56,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 20:59:56,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. after waiting 0 ms 2023-02-19 20:59:56,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 20:59:56,600 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 20:59:56,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 9e298d453970c11026570bf2ed2b600e: 2023-02-19 20:59:56,601 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => a3fcc2e1ce4d69bbf873de2e300c9446, NAME => 'testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp 2023-02-19 20:59:56,601 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:56,602 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 6e7da067f4df0f176a8f374fed05da30, disabling compactions & flushes 2023-02-19 20:59:56,602 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 20:59:56,602 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 20:59:56,602 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. after waiting 0 ms 2023-02-19 20:59:56,602 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 20:59:56,602 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 20:59:56,602 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 6e7da067f4df0f176a8f374fed05da30: 2023-02-19 20:59:56,602 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 67561ca3643b847b21dddc9042ae0bef, NAME => 'testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp 2023-02-19 20:59:56,604 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:56,605 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 8041dbf00f4076cea8295fd209618185, disabling compactions & flushes 2023-02-19 20:59:56,605 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 20:59:56,605 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 20:59:56,605 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. after waiting 0 ms 2023-02-19 20:59:56,605 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 20:59:56,605 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 20:59:56,605 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 8041dbf00f4076cea8295fd209618185: 2023-02-19 20:59:56,605 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => da0f1e605c2bd617fb518b8c79f1a68d, NAME => 'testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp 2023-02-19 20:59:56,628 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:56,628 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing a3fcc2e1ce4d69bbf873de2e300c9446, disabling compactions & flushes 2023-02-19 20:59:56,629 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 20:59:56,629 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 20:59:56,629 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. after waiting 0 ms 2023-02-19 20:59:56,629 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 20:59:56,629 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 20:59:56,629 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for a3fcc2e1ce4d69bbf873de2e300c9446: 2023-02-19 20:59:56,630 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5cb889795a604110c3b2397847de14e3, NAME => 'testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp 2023-02-19 20:59:56,631 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:56,633 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing da0f1e605c2bd617fb518b8c79f1a68d, disabling compactions & flushes 2023-02-19 20:59:56,633 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 20:59:56,633 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 20:59:56,633 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. after waiting 0 ms 2023-02-19 20:59:56,633 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 20:59:56,633 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 20:59:56,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for da0f1e605c2bd617fb518b8c79f1a68d: 2023-02-19 20:59:56,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:56,635 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 67561ca3643b847b21dddc9042ae0bef, disabling compactions & flushes 2023-02-19 20:59:56,635 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 20:59:56,635 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 20:59:56,635 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. after waiting 0 ms 2023-02-19 20:59:56,635 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 20:59:56,635 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 20:59:56,635 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 67561ca3643b847b21dddc9042ae0bef: 2023-02-19 20:59:56,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:56,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5cb889795a604110c3b2397847de14e3, disabling compactions & flushes 2023-02-19 20:59:56,662 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 20:59:56,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 20:59:56,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. after waiting 0 ms 2023-02-19 20:59:56,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 20:59:56,662 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 20:59:56,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5cb889795a604110c3b2397847de14e3: 2023-02-19 20:59:56,669 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:59:56,671 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840396670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840396670"}]},"ts":"1676840396670"} 2023-02-19 20:59:56,671 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840396670"}]},"ts":"1676840396670"} 2023-02-19 20:59:56,671 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840396670"}]},"ts":"1676840396670"} 2023-02-19 20:59:56,672 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840396670"}]},"ts":"1676840396670"} 2023-02-19 20:59:56,672 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840396670"}]},"ts":"1676840396670"} 2023-02-19 20:59:56,672 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676840396402.8041dbf00f4076cea8295fd209618185.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840396670"}]},"ts":"1676840396670"} 2023-02-19 20:59:56,672 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840396670"}]},"ts":"1676840396670"} 2023-02-19 20:59:56,672 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840396670"}]},"ts":"1676840396670"} 2023-02-19 20:59:56,672 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840396670"}]},"ts":"1676840396670"} 2023-02-19 20:59:56,672 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840396670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840396670"}]},"ts":"1676840396670"} 2023-02-19 20:59:56,722 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-19 20:59:56,724 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:59:56,725 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840396724"}]},"ts":"1676840396724"} 2023-02-19 20:59:56,727 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-19 20:59:56,737 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:59:56,754 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:59:56,754 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:59:56,754 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:59:56,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c5a77ef914048739ee7a1009051b5414, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8630f5270002fcda4479e320d28f766f, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=94a2c01c5633d7fdb30d081febbedbf4, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9e298d453970c11026570bf2ed2b600e, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6e7da067f4df0f176a8f374fed05da30, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8041dbf00f4076cea8295fd209618185, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a3fcc2e1ce4d69bbf873de2e300c9446, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=67561ca3643b847b21dddc9042ae0bef, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=da0f1e605c2bd617fb518b8c79f1a68d, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5cb889795a604110c3b2397847de14e3, ASSIGN}] 2023-02-19 20:59:56,760 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c5a77ef914048739ee7a1009051b5414, ASSIGN 2023-02-19 20:59:56,760 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8630f5270002fcda4479e320d28f766f, ASSIGN 2023-02-19 20:59:56,761 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6e7da067f4df0f176a8f374fed05da30, ASSIGN 2023-02-19 20:59:56,761 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9e298d453970c11026570bf2ed2b600e, ASSIGN 2023-02-19 20:59:56,762 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c5a77ef914048739ee7a1009051b5414, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40243,1676840392539; forceNewPlan=false, retain=false 2023-02-19 20:59:56,762 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8630f5270002fcda4479e320d28f766f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40243,1676840392539; forceNewPlan=false, retain=false 2023-02-19 20:59:56,763 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6e7da067f4df0f176a8f374fed05da30, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40243,1676840392539; forceNewPlan=false, retain=false 2023-02-19 20:59:56,763 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9e298d453970c11026570bf2ed2b600e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44193,1676840392492; forceNewPlan=false, retain=false 2023-02-19 20:59:56,763 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5cb889795a604110c3b2397847de14e3, ASSIGN 2023-02-19 20:59:56,764 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=da0f1e605c2bd617fb518b8c79f1a68d, ASSIGN 2023-02-19 20:59:56,764 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=67561ca3643b847b21dddc9042ae0bef, ASSIGN 2023-02-19 20:59:56,765 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a3fcc2e1ce4d69bbf873de2e300c9446, ASSIGN 2023-02-19 20:59:56,765 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8041dbf00f4076cea8295fd209618185, ASSIGN 2023-02-19 20:59:56,765 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5cb889795a604110c3b2397847de14e3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44193,1676840392492; forceNewPlan=false, retain=false 2023-02-19 20:59:56,766 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=da0f1e605c2bd617fb518b8c79f1a68d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44193,1676840392492; forceNewPlan=false, retain=false 2023-02-19 20:59:56,766 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=67561ca3643b847b21dddc9042ae0bef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40243,1676840392539; forceNewPlan=false, retain=false 2023-02-19 20:59:56,767 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a3fcc2e1ce4d69bbf873de2e300c9446, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40243,1676840392539; forceNewPlan=false, retain=false 2023-02-19 20:59:56,768 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8041dbf00f4076cea8295fd209618185, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44193,1676840392492; forceNewPlan=false, retain=false 2023-02-19 20:59:56,768 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=94a2c01c5633d7fdb30d081febbedbf4, ASSIGN 2023-02-19 20:59:56,769 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=94a2c01c5633d7fdb30d081febbedbf4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44193,1676840392492; forceNewPlan=false, retain=false 2023-02-19 20:59:56,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:59:56,912 INFO [jenkins-hbase4:40927] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-19 20:59:56,916 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9e298d453970c11026570bf2ed2b600e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:56,916 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=5cb889795a604110c3b2397847de14e3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:56,916 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=94a2c01c5633d7fdb30d081febbedbf4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:56,916 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=da0f1e605c2bd617fb518b8c79f1a68d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:56,916 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=8041dbf00f4076cea8295fd209618185, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:56,916 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840396916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840396916"}]},"ts":"1676840396916"} 2023-02-19 20:59:56,916 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840396916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840396916"}]},"ts":"1676840396916"} 2023-02-19 20:59:56,916 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840396916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840396916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840396916"}]},"ts":"1676840396916"} 2023-02-19 20:59:56,916 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676840396402.8041dbf00f4076cea8295fd209618185.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840396916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840396916"}]},"ts":"1676840396916"} 2023-02-19 20:59:56,916 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840396916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840396916"}]},"ts":"1676840396916"} 2023-02-19 20:59:56,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure da0f1e605c2bd617fb518b8c79f1a68d, server=jenkins-hbase4.apache.org,44193,1676840392492}] 2023-02-19 20:59:56,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure 94a2c01c5633d7fdb30d081febbedbf4, server=jenkins-hbase4.apache.org,44193,1676840392492}] 2023-02-19 20:59:56,924 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure 5cb889795a604110c3b2397847de14e3, server=jenkins-hbase4.apache.org,44193,1676840392492}] 2023-02-19 20:59:56,926 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 8041dbf00f4076cea8295fd209618185, server=jenkins-hbase4.apache.org,44193,1676840392492}] 2023-02-19 20:59:56,927 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=8630f5270002fcda4479e320d28f766f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:56,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure 9e298d453970c11026570bf2ed2b600e, server=jenkins-hbase4.apache.org,44193,1676840392492}] 2023-02-19 20:59:56,927 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396927"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840396927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840396927"}]},"ts":"1676840396927"} 2023-02-19 20:59:56,929 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=a3fcc2e1ce4d69bbf873de2e300c9446, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:56,929 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840396929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840396929"}]},"ts":"1676840396929"} 2023-02-19 20:59:56,930 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=67561ca3643b847b21dddc9042ae0bef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:56,931 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840396930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840396930"}]},"ts":"1676840396930"} 2023-02-19 20:59:56,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=12, state=RUNNABLE; OpenRegionProcedure 8630f5270002fcda4479e320d28f766f, server=jenkins-hbase4.apache.org,40243,1676840392539}] 2023-02-19 20:59:56,933 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure a3fcc2e1ce4d69bbf873de2e300c9446, server=jenkins-hbase4.apache.org,40243,1676840392539}] 2023-02-19 20:59:56,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 67561ca3643b847b21dddc9042ae0bef, server=jenkins-hbase4.apache.org,40243,1676840392539}] 2023-02-19 20:59:56,934 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c5a77ef914048739ee7a1009051b5414, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:56,934 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840396934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840396934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840396934"}]},"ts":"1676840396934"} 2023-02-19 20:59:56,935 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6e7da067f4df0f176a8f374fed05da30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:56,936 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840396935"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840396935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840396935"}]},"ts":"1676840396935"} 2023-02-19 20:59:56,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=11, state=RUNNABLE; OpenRegionProcedure c5a77ef914048739ee7a1009051b5414, server=jenkins-hbase4.apache.org,40243,1676840392539}] 2023-02-19 20:59:56,946 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure 6e7da067f4df0f176a8f374fed05da30, server=jenkins-hbase4.apache.org,40243,1676840392539}] 2023-02-19 20:59:57,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 20:59:57,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9e298d453970c11026570bf2ed2b600e, NAME => 'testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-19 20:59:57,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9e298d453970c11026570bf2ed2b600e 2023-02-19 20:59:57,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:57,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9e298d453970c11026570bf2ed2b600e 2023-02-19 20:59:57,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9e298d453970c11026570bf2ed2b600e 2023-02-19 20:59:57,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:59:57,084 INFO [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9e298d453970c11026570bf2ed2b600e 2023-02-19 20:59:57,087 DEBUG [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1 2023-02-19 20:59:57,087 DEBUG [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1 2023-02-19 20:59:57,087 INFO [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e298d453970c11026570bf2ed2b600e columnFamilyName f1 2023-02-19 20:59:57,088 INFO [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] regionserver.HStore(310): Store=9e298d453970c11026570bf2ed2b600e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,088 INFO [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9e298d453970c11026570bf2ed2b600e 2023-02-19 20:59:57,091 DEBUG [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2 2023-02-19 20:59:57,091 DEBUG [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2 2023-02-19 20:59:57,092 INFO [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e298d453970c11026570bf2ed2b600e columnFamilyName f2 2023-02-19 20:59:57,092 INFO [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] regionserver.HStore(310): Store=9e298d453970c11026570bf2ed2b600e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e 2023-02-19 20:59:57,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e 2023-02-19 20:59:57,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:59:57,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 20:59:57,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 67561ca3643b847b21dddc9042ae0bef, NAME => 'testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-19 20:59:57,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 67561ca3643b847b21dddc9042ae0bef 2023-02-19 20:59:57,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:57,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 67561ca3643b847b21dddc9042ae0bef 2023-02-19 20:59:57,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 67561ca3643b847b21dddc9042ae0bef 2023-02-19 20:59:57,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9e298d453970c11026570bf2ed2b600e 2023-02-19 20:59:57,103 INFO [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 67561ca3643b847b21dddc9042ae0bef 2023-02-19 20:59:57,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:57,105 DEBUG [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1 2023-02-19 20:59:57,106 DEBUG [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1 2023-02-19 20:59:57,106 INFO [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67561ca3643b847b21dddc9042ae0bef columnFamilyName f1 2023-02-19 20:59:57,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9e298d453970c11026570bf2ed2b600e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60762980, jitterRate=-0.09456104040145874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:59:57,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9e298d453970c11026570bf2ed2b600e: 2023-02-19 20:59:57,107 INFO [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] regionserver.HStore(310): Store=67561ca3643b847b21dddc9042ae0bef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,107 INFO [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 67561ca3643b847b21dddc9042ae0bef 2023-02-19 20:59:57,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e., pid=25, masterSystemTime=1676840397073 2023-02-19 20:59:57,110 DEBUG [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2 2023-02-19 20:59:57,110 DEBUG [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2 2023-02-19 20:59:57,110 INFO [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67561ca3643b847b21dddc9042ae0bef columnFamilyName f2 2023-02-19 20:59:57,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 20:59:57,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 20:59:57,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 20:59:57,111 INFO [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] regionserver.HStore(310): Store=67561ca3643b847b21dddc9042ae0bef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 94a2c01c5633d7fdb30d081febbedbf4, NAME => 'testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-19 20:59:57,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 20:59:57,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:57,113 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9e298d453970c11026570bf2ed2b600e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:57,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 20:59:57,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 20:59:57,113 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840397113"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840397113"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840397113"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840397113"}]},"ts":"1676840397113"} 2023-02-19 20:59:57,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef 2023-02-19 20:59:57,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef 2023-02-19 20:59:57,116 INFO [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 20:59:57,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:59:57,123 DEBUG [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1 2023-02-19 20:59:57,123 DEBUG [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1 2023-02-19 20:59:57,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-19 20:59:57,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure 9e298d453970c11026570bf2ed2b600e, server=jenkins-hbase4.apache.org,44193,1676840392492 in 189 msec 2023-02-19 20:59:57,124 INFO [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94a2c01c5633d7fdb30d081febbedbf4 columnFamilyName f1 2023-02-19 20:59:57,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 67561ca3643b847b21dddc9042ae0bef 2023-02-19 20:59:57,125 INFO [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] regionserver.HStore(310): Store=94a2c01c5633d7fdb30d081febbedbf4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,125 INFO [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 20:59:57,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9e298d453970c11026570bf2ed2b600e, ASSIGN in 370 msec 2023-02-19 20:59:57,129 DEBUG [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2 2023-02-19 20:59:57,129 DEBUG [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2 2023-02-19 20:59:57,129 INFO [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94a2c01c5633d7fdb30d081febbedbf4 columnFamilyName f2 2023-02-19 20:59:57,130 INFO [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] regionserver.HStore(310): Store=94a2c01c5633d7fdb30d081febbedbf4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:57,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 67561ca3643b847b21dddc9042ae0bef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72612080, jitterRate=0.08200430870056152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:59:57,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 67561ca3643b847b21dddc9042ae0bef: 2023-02-19 20:59:57,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 20:59:57,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 20:59:57,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef., pid=28, masterSystemTime=1676840397093 2023-02-19 20:59:57,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 20:59:57,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 20:59:57,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 20:59:57,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:59:57,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a3fcc2e1ce4d69bbf873de2e300c9446, NAME => 'testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-19 20:59:57,136 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=67561ca3643b847b21dddc9042ae0bef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:57,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 20:59:57,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:57,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 20:59:57,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 20:59:57,136 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840397136"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840397136"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840397136"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840397136"}]},"ts":"1676840397136"} 2023-02-19 20:59:57,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 20:59:57,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-19 20:59:57,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 67561ca3643b847b21dddc9042ae0bef, server=jenkins-hbase4.apache.org,40243,1676840392539 in 206 msec 2023-02-19 20:59:57,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=67561ca3643b847b21dddc9042ae0bef, ASSIGN in 389 msec 2023-02-19 20:59:57,152 INFO [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 20:59:57,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:57,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 94a2c01c5633d7fdb30d081febbedbf4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74898984, jitterRate=0.1160818338394165}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:59:57,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 94a2c01c5633d7fdb30d081febbedbf4: 2023-02-19 20:59:57,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4., pid=22, masterSystemTime=1676840397073 2023-02-19 20:59:57,155 DEBUG [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1 2023-02-19 20:59:57,155 DEBUG [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1 2023-02-19 20:59:57,156 INFO [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3fcc2e1ce4d69bbf873de2e300c9446 columnFamilyName f1 2023-02-19 20:59:57,157 INFO [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] regionserver.HStore(310): Store=a3fcc2e1ce4d69bbf873de2e300c9446/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,157 INFO [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 20:59:57,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 20:59:57,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 20:59:57,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 20:59:57,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8041dbf00f4076cea8295fd209618185, NAME => 'testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-19 20:59:57,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8041dbf00f4076cea8295fd209618185 2023-02-19 20:59:57,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:57,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8041dbf00f4076cea8295fd209618185 2023-02-19 20:59:57,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8041dbf00f4076cea8295fd209618185 2023-02-19 20:59:57,160 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=94a2c01c5633d7fdb30d081febbedbf4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:57,161 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840397160"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840397160"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840397160"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840397160"}]},"ts":"1676840397160"} 2023-02-19 20:59:57,161 INFO [StoreOpener-8041dbf00f4076cea8295fd209618185-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8041dbf00f4076cea8295fd209618185 2023-02-19 20:59:57,162 DEBUG [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2 2023-02-19 20:59:57,163 DEBUG [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2 2023-02-19 20:59:57,164 DEBUG [StoreOpener-8041dbf00f4076cea8295fd209618185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1 2023-02-19 20:59:57,164 INFO [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3fcc2e1ce4d69bbf873de2e300c9446 columnFamilyName f2 2023-02-19 20:59:57,164 DEBUG [StoreOpener-8041dbf00f4076cea8295fd209618185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1 2023-02-19 20:59:57,165 INFO [StoreOpener-8041dbf00f4076cea8295fd209618185-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8041dbf00f4076cea8295fd209618185 columnFamilyName f1 2023-02-19 20:59:57,166 INFO [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] regionserver.HStore(310): Store=a3fcc2e1ce4d69bbf873de2e300c9446/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,167 INFO [StoreOpener-8041dbf00f4076cea8295fd209618185-1] regionserver.HStore(310): Store=8041dbf00f4076cea8295fd209618185/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,168 INFO [StoreOpener-8041dbf00f4076cea8295fd209618185-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8041dbf00f4076cea8295fd209618185 2023-02-19 20:59:57,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 20:59:57,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-19 20:59:57,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure 94a2c01c5633d7fdb30d081febbedbf4, server=jenkins-hbase4.apache.org,44193,1676840392492 in 243 msec 2023-02-19 20:59:57,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 20:59:57,170 DEBUG [StoreOpener-8041dbf00f4076cea8295fd209618185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2 2023-02-19 20:59:57,170 DEBUG [StoreOpener-8041dbf00f4076cea8295fd209618185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2 2023-02-19 20:59:57,171 INFO [StoreOpener-8041dbf00f4076cea8295fd209618185-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8041dbf00f4076cea8295fd209618185 columnFamilyName f2 2023-02-19 20:59:57,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=94a2c01c5633d7fdb30d081febbedbf4, ASSIGN in 415 msec 2023-02-19 20:59:57,174 INFO [StoreOpener-8041dbf00f4076cea8295fd209618185-1] regionserver.HStore(310): Store=8041dbf00f4076cea8295fd209618185/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:59:57,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185 2023-02-19 20:59:57,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185 2023-02-19 20:59:57,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 20:59:57,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:59:57,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8041dbf00f4076cea8295fd209618185 2023-02-19 20:59:57,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:57,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a3fcc2e1ce4d69bbf873de2e300c9446; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63598166, jitterRate=-0.05231347680091858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:59:57,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a3fcc2e1ce4d69bbf873de2e300c9446: 2023-02-19 20:59:57,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446., pid=27, masterSystemTime=1676840397093 2023-02-19 20:59:57,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:57,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8041dbf00f4076cea8295fd209618185; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59621714, jitterRate=-0.11156722903251648}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:59:57,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8041dbf00f4076cea8295fd209618185: 2023-02-19 20:59:57,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 20:59:57,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 20:59:57,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 20:59:57,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c5a77ef914048739ee7a1009051b5414, NAME => 'testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-19 20:59:57,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185., pid=24, masterSystemTime=1676840397073 2023-02-19 20:59:57,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c5a77ef914048739ee7a1009051b5414 2023-02-19 20:59:57,188 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=a3fcc2e1ce4d69bbf873de2e300c9446, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:57,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:57,188 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840397188"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840397188"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840397188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840397188"}]},"ts":"1676840397188"} 2023-02-19 20:59:57,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c5a77ef914048739ee7a1009051b5414 2023-02-19 20:59:57,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c5a77ef914048739ee7a1009051b5414 2023-02-19 20:59:57,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 20:59:57,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 20:59:57,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 20:59:57,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => da0f1e605c2bd617fb518b8c79f1a68d, NAME => 'testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-19 20:59:57,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 20:59:57,192 INFO [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c5a77ef914048739ee7a1009051b5414 2023-02-19 20:59:57,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:57,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 20:59:57,192 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=8041dbf00f4076cea8295fd209618185, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:57,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 20:59:57,192 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676840396402.8041dbf00f4076cea8295fd209618185.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840397192"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840397192"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840397192"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840397192"}]},"ts":"1676840397192"} 2023-02-19 20:59:57,194 DEBUG [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/f1 2023-02-19 20:59:57,194 DEBUG [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/f1 2023-02-19 20:59:57,195 INFO [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5a77ef914048739ee7a1009051b5414 columnFamilyName f1 2023-02-19 20:59:57,195 INFO [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 20:59:57,197 INFO [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] regionserver.HStore(310): Store=c5a77ef914048739ee7a1009051b5414/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,198 INFO [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c5a77ef914048739ee7a1009051b5414 2023-02-19 20:59:57,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-19 20:59:57,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure a3fcc2e1ce4d69bbf873de2e300c9446, server=jenkins-hbase4.apache.org,40243,1676840392539 in 259 msec 2023-02-19 20:59:57,199 DEBUG [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1 2023-02-19 20:59:57,199 DEBUG [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1 2023-02-19 20:59:57,199 INFO [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da0f1e605c2bd617fb518b8c79f1a68d columnFamilyName f1 2023-02-19 20:59:57,200 INFO [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] regionserver.HStore(310): Store=da0f1e605c2bd617fb518b8c79f1a68d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,200 INFO [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 20:59:57,200 DEBUG [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/f2 2023-02-19 20:59:57,201 DEBUG [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/f2 2023-02-19 20:59:57,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-19 20:59:57,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 8041dbf00f4076cea8295fd209618185, server=jenkins-hbase4.apache.org,44193,1676840392492 in 269 msec 2023-02-19 20:59:57,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a3fcc2e1ce4d69bbf873de2e300c9446, ASSIGN in 444 msec 2023-02-19 20:59:57,202 INFO [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5a77ef914048739ee7a1009051b5414 columnFamilyName f2 2023-02-19 20:59:57,203 DEBUG [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2 2023-02-19 20:59:57,203 DEBUG [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2 2023-02-19 20:59:57,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8041dbf00f4076cea8295fd209618185, ASSIGN in 447 msec 2023-02-19 20:59:57,204 INFO [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da0f1e605c2bd617fb518b8c79f1a68d columnFamilyName f2 2023-02-19 20:59:57,205 INFO [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] regionserver.HStore(310): Store=da0f1e605c2bd617fb518b8c79f1a68d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 20:59:57,208 INFO [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] regionserver.HStore(310): Store=c5a77ef914048739ee7a1009051b5414/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 20:59:57,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414 2023-02-19 20:59:57,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414 2023-02-19 20:59:57,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:59:57,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 20:59:57,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:57,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened da0f1e605c2bd617fb518b8c79f1a68d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63781315, jitterRate=-0.049584344029426575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:59:57,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for da0f1e605c2bd617fb518b8c79f1a68d: 2023-02-19 20:59:57,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d., pid=21, masterSystemTime=1676840397073 2023-02-19 20:59:57,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 20:59:57,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 20:59:57,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 20:59:57,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5cb889795a604110c3b2397847de14e3, NAME => 'testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-19 20:59:57,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5cb889795a604110c3b2397847de14e3 2023-02-19 20:59:57,223 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=da0f1e605c2bd617fb518b8c79f1a68d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:57,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:57,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5cb889795a604110c3b2397847de14e3 2023-02-19 20:59:57,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5cb889795a604110c3b2397847de14e3 2023-02-19 20:59:57,223 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840397223"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840397223"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840397223"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840397223"}]},"ts":"1676840397223"} 2023-02-19 20:59:57,225 INFO [StoreOpener-5cb889795a604110c3b2397847de14e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5cb889795a604110c3b2397847de14e3 2023-02-19 20:59:57,228 DEBUG [StoreOpener-5cb889795a604110c3b2397847de14e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/f1 2023-02-19 20:59:57,228 DEBUG [StoreOpener-5cb889795a604110c3b2397847de14e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/f1 2023-02-19 20:59:57,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:59:57,228 INFO [StoreOpener-5cb889795a604110c3b2397847de14e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cb889795a604110c3b2397847de14e3 columnFamilyName f1 2023-02-19 20:59:57,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c5a77ef914048739ee7a1009051b5414 2023-02-19 20:59:57,231 INFO [StoreOpener-5cb889795a604110c3b2397847de14e3-1] regionserver.HStore(310): Store=5cb889795a604110c3b2397847de14e3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,231 INFO [StoreOpener-5cb889795a604110c3b2397847de14e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5cb889795a604110c3b2397847de14e3 2023-02-19 20:59:57,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-19 20:59:57,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure da0f1e605c2bd617fb518b8c79f1a68d, server=jenkins-hbase4.apache.org,44193,1676840392492 in 307 msec 2023-02-19 20:59:57,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=da0f1e605c2bd617fb518b8c79f1a68d, ASSIGN in 478 msec 2023-02-19 20:59:57,235 DEBUG [StoreOpener-5cb889795a604110c3b2397847de14e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/f2 2023-02-19 20:59:57,235 DEBUG [StoreOpener-5cb889795a604110c3b2397847de14e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/f2 2023-02-19 20:59:57,235 INFO [StoreOpener-5cb889795a604110c3b2397847de14e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cb889795a604110c3b2397847de14e3 columnFamilyName f2 2023-02-19 20:59:57,236 INFO [StoreOpener-5cb889795a604110c3b2397847de14e3-1] regionserver.HStore(310): Store=5cb889795a604110c3b2397847de14e3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:57,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3 2023-02-19 20:59:57,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c5a77ef914048739ee7a1009051b5414; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65022946, jitterRate=-0.031082600355148315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:59:57,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3 2023-02-19 20:59:57,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c5a77ef914048739ee7a1009051b5414: 2023-02-19 20:59:57,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414., pid=29, masterSystemTime=1676840397093 2023-02-19 20:59:57,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:59:57,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 20:59:57,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 20:59:57,245 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c5a77ef914048739ee7a1009051b5414, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:57,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5cb889795a604110c3b2397847de14e3 2023-02-19 20:59:57,245 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840397244"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840397244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840397244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840397244"}]},"ts":"1676840397244"} 2023-02-19 20:59:57,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 20:59:57,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8630f5270002fcda4479e320d28f766f, NAME => 'testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-19 20:59:57,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8630f5270002fcda4479e320d28f766f 2023-02-19 20:59:57,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:57,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8630f5270002fcda4479e320d28f766f 2023-02-19 20:59:57,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8630f5270002fcda4479e320d28f766f 2023-02-19 20:59:57,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=11 2023-02-19 20:59:57,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=11, state=SUCCESS; OpenRegionProcedure c5a77ef914048739ee7a1009051b5414, server=jenkins-hbase4.apache.org,40243,1676840392539 in 304 msec 2023-02-19 20:59:57,252 INFO [StoreOpener-8630f5270002fcda4479e320d28f766f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8630f5270002fcda4479e320d28f766f 2023-02-19 20:59:57,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:57,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c5a77ef914048739ee7a1009051b5414, ASSIGN in 497 msec 2023-02-19 20:59:57,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5cb889795a604110c3b2397847de14e3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70305828, jitterRate=0.04763847589492798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:59:57,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5cb889795a604110c3b2397847de14e3: 2023-02-19 20:59:57,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3., pid=23, masterSystemTime=1676840397073 2023-02-19 20:59:57,255 DEBUG [StoreOpener-8630f5270002fcda4479e320d28f766f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1 2023-02-19 20:59:57,255 DEBUG [StoreOpener-8630f5270002fcda4479e320d28f766f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1 2023-02-19 20:59:57,255 INFO [StoreOpener-8630f5270002fcda4479e320d28f766f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8630f5270002fcda4479e320d28f766f columnFamilyName f1 2023-02-19 20:59:57,256 INFO [StoreOpener-8630f5270002fcda4479e320d28f766f-1] regionserver.HStore(310): Store=8630f5270002fcda4479e320d28f766f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,256 INFO [StoreOpener-8630f5270002fcda4479e320d28f766f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8630f5270002fcda4479e320d28f766f 2023-02-19 20:59:57,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 20:59:57,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 20:59:57,258 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=5cb889795a604110c3b2397847de14e3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:57,258 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840397258"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840397258"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840397258"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840397258"}]},"ts":"1676840397258"} 2023-02-19 20:59:57,259 DEBUG [StoreOpener-8630f5270002fcda4479e320d28f766f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2 2023-02-19 20:59:57,260 DEBUG [StoreOpener-8630f5270002fcda4479e320d28f766f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2 2023-02-19 20:59:57,260 INFO [StoreOpener-8630f5270002fcda4479e320d28f766f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8630f5270002fcda4479e320d28f766f columnFamilyName f2 2023-02-19 20:59:57,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-19 20:59:57,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure 5cb889795a604110c3b2397847de14e3, server=jenkins-hbase4.apache.org,44193,1676840392492 in 337 msec 2023-02-19 20:59:57,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5cb889795a604110c3b2397847de14e3, ASSIGN in 509 msec 2023-02-19 20:59:57,271 INFO [StoreOpener-8630f5270002fcda4479e320d28f766f-1] regionserver.HStore(310): Store=8630f5270002fcda4479e320d28f766f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f 2023-02-19 20:59:57,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f 2023-02-19 20:59:57,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:59:57,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8630f5270002fcda4479e320d28f766f 2023-02-19 20:59:57,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:57,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8630f5270002fcda4479e320d28f766f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63066529, jitterRate=-0.060235485434532166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:59:57,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8630f5270002fcda4479e320d28f766f: 2023-02-19 20:59:57,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f., pid=26, masterSystemTime=1676840397093 2023-02-19 20:59:57,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 20:59:57,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 20:59:57,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 20:59:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6e7da067f4df0f176a8f374fed05da30, NAME => 'testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-19 20:59:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6e7da067f4df0f176a8f374fed05da30 2023-02-19 20:59:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:59:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6e7da067f4df0f176a8f374fed05da30 2023-02-19 20:59:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6e7da067f4df0f176a8f374fed05da30 2023-02-19 20:59:57,286 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=8630f5270002fcda4479e320d28f766f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:57,287 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840397286"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840397286"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840397286"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840397286"}]},"ts":"1676840397286"} 2023-02-19 20:59:57,288 INFO [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6e7da067f4df0f176a8f374fed05da30 2023-02-19 20:59:57,290 DEBUG [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1 2023-02-19 20:59:57,291 DEBUG [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1 2023-02-19 20:59:57,291 INFO [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e7da067f4df0f176a8f374fed05da30 columnFamilyName f1 2023-02-19 20:59:57,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=12 2023-02-19 20:59:57,292 INFO [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] regionserver.HStore(310): Store=6e7da067f4df0f176a8f374fed05da30/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=12, state=SUCCESS; OpenRegionProcedure 8630f5270002fcda4479e320d28f766f, server=jenkins-hbase4.apache.org,40243,1676840392539 in 358 msec 2023-02-19 20:59:57,292 INFO [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6e7da067f4df0f176a8f374fed05da30 2023-02-19 20:59:57,294 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8630f5270002fcda4479e320d28f766f, ASSIGN in 538 msec 2023-02-19 20:59:57,295 DEBUG [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2 2023-02-19 20:59:57,295 DEBUG [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2 2023-02-19 20:59:57,295 INFO [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e7da067f4df0f176a8f374fed05da30 columnFamilyName f2 2023-02-19 20:59:57,296 INFO [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] regionserver.HStore(310): Store=6e7da067f4df0f176a8f374fed05da30/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:59:57,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30 2023-02-19 20:59:57,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30 2023-02-19 20:59:57,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:59:57,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6e7da067f4df0f176a8f374fed05da30 2023-02-19 20:59:57,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:59:57,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6e7da067f4df0f176a8f374fed05da30; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73235852, jitterRate=0.09129923582077026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:59:57,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6e7da067f4df0f176a8f374fed05da30: 2023-02-19 20:59:57,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30., pid=30, masterSystemTime=1676840397093 2023-02-19 20:59:57,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 20:59:57,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 20:59:57,311 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6e7da067f4df0f176a8f374fed05da30, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:57,311 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840397311"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840397311"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840397311"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840397311"}]},"ts":"1676840397311"} 2023-02-19 20:59:57,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-19 20:59:57,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure 6e7da067f4df0f176a8f374fed05da30, server=jenkins-hbase4.apache.org,40243,1676840392539 in 369 msec 2023-02-19 20:59:57,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-19 20:59:57,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6e7da067f4df0f176a8f374fed05da30, ASSIGN in 563 msec 2023-02-19 20:59:57,321 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:59:57,322 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840397322"}]},"ts":"1676840397322"} 2023-02-19 20:59:57,324 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-19 20:59:57,327 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:59:57,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 920 msec 2023-02-19 20:59:57,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:59:57,586 INFO [Listener at localhost/38225] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-19 20:59:57,586 DEBUG [Listener at localhost/38225] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-19 20:59:57,588 INFO [Listener at localhost/38225] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:59:57,599 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-19 20:59:57,600 INFO [Listener at localhost/38225] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:59:57,604 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-19 20:59:57,604 INFO [Listener at localhost/38225] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 20:59:57,739 DEBUG [hconnection-0x3cc35720-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:59:57,778 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43910, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:59:57,820 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40243] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 20:59:57,822 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44193] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 20:59:58,078 INFO [Listener at localhost/38225] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 20:59:58,082 INFO [Listener at localhost/38225] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 20:59:58,093 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 20:59:58,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676840398093 (current time:1676840398093). 2023-02-19 20:59:58,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 20:59:58,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] zookeeper.ReadOnlyZKClient(139): Connect 0x292b5846 to 127.0.0.1:50373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:59:58,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d781b76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:59:58,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:59:58,106 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49590, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:59:58,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x292b5846 to 127.0.0.1:50373 2023-02-19 20:59:58,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:59:58,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 20:59:58,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 20:59:58,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 20:59:58,137 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 20:59:58,139 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676840998139 2023-02-19 20:59:58,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 20:59:58,144 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-19 20:59:58,154 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 20:59:58,156 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 20:59:58,156 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 20:59:58,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 20:59:58,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 28 msec 2023-02-19 20:59:58,157 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 20:59:58,158 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676840998158 2023-02-19 20:59:58,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-19 20:59:58,194 INFO [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-19 20:59:58,194 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:59:58,195 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-19 20:59:58,195 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-19 20:59:58,196 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:58,196 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:59:58,198 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:59:58,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:59:58,199 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:59:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:59:58,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:59:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:59:58,199 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:59:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:59:58,200 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:58,200 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:58,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:58,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-19 20:59:58,201 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-19 20:59:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:59:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:59:58,201 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:59:58,202 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-19 20:59:58,202 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-19 20:59:58,208 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-19 20:59:58,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-19 20:59:58,211 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-19 20:59:58,211 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:59:58,212 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-19 20:59:58,212 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:59:58,212 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 20:59:58,212 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 20:59:58,213 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-19 20:59:58,213 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-19 20:59:58,213 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40243,1676840392539' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-19 20:59:58,213 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44193,1676840392492' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-19 20:59:58,215 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:58,215 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:58,215 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:58,215 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:59:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:59:58,216 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:58,216 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:59:58,216 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:58,216 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:59:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:59:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:59:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:59:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:59:58,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40243,1676840392539' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-19 20:59:58,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54a14e89[Count = 1] remaining members to acquire global barrier 2023-02-19 20:59:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:59:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:59:58,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:59:58,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:59:58,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:59:58,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:58,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:58,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:59:58,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44193,1676840392492' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-19 20:59:58,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54a14e89[Count = 0] remaining members to acquire global barrier 2023-02-19 20:59:58,222 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-19 20:59:58,222 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:58,224 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:58,224 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:58,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:58,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:58,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:58,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:58,224 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 20:59:58,224 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 20:59:58,224 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:58,225 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:58,225 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:59:58,225 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 20:59:58,226 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 20:59:58,226 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. started... 2023-02-19 20:59:58,226 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 20:59:58,226 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 20:59:58,226 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. started... 2023-02-19 20:59:58,226 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 20:59:58,226 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 20:59:58,226 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. started... 2023-02-19 20:59:58,226 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. started... 2023-02-19 20:59:58,226 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 20:59:58,227 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 20:59:58,226 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 20:59:58,226 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. started... 2023-02-19 20:59:58,226 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 20:59:58,227 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. started... 2023-02-19 20:59:58,229 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] regionserver.HRegion(2744): Flushing a3fcc2e1ce4d69bbf873de2e300c9446 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:59:58,229 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HRegion(2744): Flushing da0f1e605c2bd617fb518b8c79f1a68d 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 20:59:58,229 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 6e7da067f4df0f176a8f374fed05da30 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:59:58,229 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 94a2c01c5633d7fdb30d081febbedbf4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:59:58,230 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 8041dbf00f4076cea8295fd209618185 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:59:58,230 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 67561ca3643b847b21dddc9042ae0bef 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:59:58,256 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:59:58,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:59:58,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:59:58,262 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 20:59:58,437 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/.tmp/f1/32c5ee0a926b4bdaa211500dfb51f047 2023-02-19 20:59:58,445 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/.tmp/f1/2b6f5ba51b534709a24c7557ae706be0 2023-02-19 20:59:58,445 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/.tmp/f1/01b7bf11382f4f67b3d88ee35bbfd663 2023-02-19 20:59:58,447 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/.tmp/f1/b02ef55326734caeadaf1c60182bbb81 2023-02-19 20:59:58,450 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/.tmp/f1/b481589f2d2d44dda8f997fe64de66fe 2023-02-19 20:59:58,462 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:59:58,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:59:58,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:59:58,464 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-19 20:59:58,573 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/.tmp/f2/2d7a73c3796f4305b671edb6cf4dce03 2023-02-19 20:59:58,593 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/.tmp/f1/2b6f5ba51b534709a24c7557ae706be0 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1/2b6f5ba51b534709a24c7557ae706be0 2023-02-19 20:59:58,593 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/.tmp/f2/c1f191de22d1409d893f40b86e86c933 2023-02-19 20:59:58,593 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/.tmp/f2/3a4b531cdb32482abf0014cf3059de0e 2023-02-19 20:59:58,595 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/.tmp/f2/9227e7682d1e4c3ab2bca3fc8809c97c 2023-02-19 20:59:58,601 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/.tmp/f2/c7f8dfde976e40989ead73ee6bc8f5bc 2023-02-19 20:59:58,613 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1/2b6f5ba51b534709a24c7557ae706be0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:59:58,613 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/.tmp/f1/b02ef55326734caeadaf1c60182bbb81 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1/b02ef55326734caeadaf1c60182bbb81 2023-02-19 20:59:58,616 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/.tmp/f1/32c5ee0a926b4bdaa211500dfb51f047 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1/32c5ee0a926b4bdaa211500dfb51f047 2023-02-19 20:59:58,616 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/.tmp/f2/2d7a73c3796f4305b671edb6cf4dce03 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2/2d7a73c3796f4305b671edb6cf4dce03 2023-02-19 20:59:58,616 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/.tmp/f1/01b7bf11382f4f67b3d88ee35bbfd663 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1/01b7bf11382f4f67b3d88ee35bbfd663 2023-02-19 20:59:58,616 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/.tmp/f1/b481589f2d2d44dda8f997fe64de66fe as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1/b481589f2d2d44dda8f997fe64de66fe 2023-02-19 20:59:58,637 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2/2d7a73c3796f4305b671edb6cf4dce03, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:59:58,638 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1/b02ef55326734caeadaf1c60182bbb81, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:59:58,640 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1/b481589f2d2d44dda8f997fe64de66fe, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:59:58,640 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 94a2c01c5633d7fdb30d081febbedbf4 in 412ms, sequenceid=5, compaction requested=false 2023-02-19 20:59:58,641 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1/01b7bf11382f4f67b3d88ee35bbfd663, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:59:58,641 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/.tmp/f2/c7f8dfde976e40989ead73ee6bc8f5bc as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2/c7f8dfde976e40989ead73ee6bc8f5bc 2023-02-19 20:59:58,642 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/.tmp/f2/3a4b531cdb32482abf0014cf3059de0e as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2/3a4b531cdb32482abf0014cf3059de0e 2023-02-19 20:59:58,642 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1/32c5ee0a926b4bdaa211500dfb51f047, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:59:58,644 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-19 20:59:58,644 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/.tmp/f2/c1f191de22d1409d893f40b86e86c933 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2/c1f191de22d1409d893f40b86e86c933 2023-02-19 20:59:58,645 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/.tmp/f2/9227e7682d1e4c3ab2bca3fc8809c97c as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2/9227e7682d1e4c3ab2bca3fc8809c97c 2023-02-19 20:59:58,647 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 94a2c01c5633d7fdb30d081febbedbf4: 2023-02-19 20:59:58,648 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,656 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:59:58,659 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2/3a4b531cdb32482abf0014cf3059de0e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:59:58,661 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8041dbf00f4076cea8295fd209618185 in 433ms, sequenceid=5, compaction requested=false 2023-02-19 20:59:58,662 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8041dbf00f4076cea8295fd209618185: 2023-02-19 20:59:58,663 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,663 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:59:58,663 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1/b02ef55326734caeadaf1c60182bbb81] hfiles 2023-02-19 20:59:58,663 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1/b02ef55326734caeadaf1c60182bbb81 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,668 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2/3a4b531cdb32482abf0014cf3059de0e] hfiles 2023-02-19 20:59:58,668 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2/3a4b531cdb32482abf0014cf3059de0e for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,671 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2/c1f191de22d1409d893f40b86e86c933, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:59:58,673 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for da0f1e605c2bd617fb518b8c79f1a68d in 444ms, sequenceid=5, compaction requested=false 2023-02-19 20:59:58,673 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for da0f1e605c2bd617fb518b8c79f1a68d: 2023-02-19 20:59:58,673 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,673 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:59:58,673 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1/01b7bf11382f4f67b3d88ee35bbfd663] hfiles 2023-02-19 20:59:58,673 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1/01b7bf11382f4f67b3d88ee35bbfd663 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,673 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2/c1f191de22d1409d893f40b86e86c933] hfiles 2023-02-19 20:59:58,673 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2/c1f191de22d1409d893f40b86e86c933 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,663 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1/2b6f5ba51b534709a24c7557ae706be0] hfiles 2023-02-19 20:59:58,685 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1/2b6f5ba51b534709a24c7557ae706be0 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,685 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2/2d7a73c3796f4305b671edb6cf4dce03] hfiles 2023-02-19 20:59:58,685 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2/2d7a73c3796f4305b671edb6cf4dce03 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,686 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2/c7f8dfde976e40989ead73ee6bc8f5bc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:59:58,688 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6e7da067f4df0f176a8f374fed05da30 in 460ms, sequenceid=5, compaction requested=false 2023-02-19 20:59:58,688 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 6e7da067f4df0f176a8f374fed05da30: 2023-02-19 20:59:58,688 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,688 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:59:58,688 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1/b481589f2d2d44dda8f997fe64de66fe] hfiles 2023-02-19 20:59:58,688 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1/b481589f2d2d44dda8f997fe64de66fe for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,688 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2/c7f8dfde976e40989ead73ee6bc8f5bc] hfiles 2023-02-19 20:59:58,688 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2/c7f8dfde976e40989ead73ee6bc8f5bc for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,753 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2/9227e7682d1e4c3ab2bca3fc8809c97c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:59:58,755 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 67561ca3643b847b21dddc9042ae0bef in 525ms, sequenceid=5, compaction requested=false 2023-02-19 20:59:58,755 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 67561ca3643b847b21dddc9042ae0bef: 2023-02-19 20:59:58,755 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,755 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:59:58,755 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1/32c5ee0a926b4bdaa211500dfb51f047] hfiles 2023-02-19 20:59:58,755 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1/32c5ee0a926b4bdaa211500dfb51f047 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,755 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2/9227e7682d1e4c3ab2bca3fc8809c97c] hfiles 2023-02-19 20:59:58,755 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2/9227e7682d1e4c3ab2bca3fc8809c97c for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,765 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:59:58,765 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. completed. 2023-02-19 20:59:58,765 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 20:59:58,766 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 20:59:58,766 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 20:59:58,767 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. started... 2023-02-19 20:59:58,782 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5cb889795a604110c3b2397847de14e3: 2023-02-19 20:59:58,782 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,783 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:59:58,783 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:59:58,783 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:59:58,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:59:58,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:59:58,785 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-19 20:59:58,798 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. completed. 2023-02-19 20:59:58,799 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 20:59:58,799 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 20:59:58,799 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. started... 2023-02-19 20:59:58,799 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 20:59:58,801 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 9e298d453970c11026570bf2ed2b600e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:59:58,813 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. completed. 2023-02-19 20:59:58,813 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 20:59:58,813 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 20:59:58,813 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 20:59:58,814 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. started... 2023-02-19 20:59:58,815 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. completed. 2023-02-19 20:59:58,815 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 20:59:58,815 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 8630f5270002fcda4479e320d28f766f 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 20:59:58,815 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 20:59:58,836 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. completed. 2023-02-19 20:59:58,836 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 20:59:58,837 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 20:59:58,837 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 20:59:58,837 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. started... 2023-02-19 20:59:58,838 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c5a77ef914048739ee7a1009051b5414: 2023-02-19 20:59:58,838 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,838 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:59:58,838 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:59:58,838 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:59:58,851 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/.tmp/f1/02250848e51348039f4539b335790407 2023-02-19 20:59:58,862 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. completed. 2023-02-19 20:59:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 20:59:58,863 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 20:59:58,866 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/.tmp/f1/5a8314307d8e4c39ba7d4c04858abbfb 2023-02-19 20:59:58,904 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. completed. 2023-02-19 20:59:58,904 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 20:59:58,904 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 20:59:58,904 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/.tmp/f1/6ff5f9333afc425d931dafe790872c0a 2023-02-19 20:59:58,913 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/.tmp/f2/79fa1b0ad9ca4fc298d29ef2e1c47d35 2023-02-19 20:59:58,921 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/.tmp/f1/5a8314307d8e4c39ba7d4c04858abbfb as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1/5a8314307d8e4c39ba7d4c04858abbfb 2023-02-19 20:59:58,929 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1/5a8314307d8e4c39ba7d4c04858abbfb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:59:58,931 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/.tmp/f2/7926389b5636443185dfe9dbc5ec02de 2023-02-19 20:59:58,932 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/.tmp/f2/79fa1b0ad9ca4fc298d29ef2e1c47d35 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2/79fa1b0ad9ca4fc298d29ef2e1c47d35 2023-02-19 20:59:58,948 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2/79fa1b0ad9ca4fc298d29ef2e1c47d35, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:59:58,948 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/.tmp/f1/02250848e51348039f4539b335790407 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1/02250848e51348039f4539b335790407 2023-02-19 20:59:58,949 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/.tmp/f2/8c632d4e394a4a1f953c4d1057fdf3e3 2023-02-19 20:59:58,949 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9e298d453970c11026570bf2ed2b600e in 149ms, sequenceid=5, compaction requested=false 2023-02-19 20:59:58,950 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 9e298d453970c11026570bf2ed2b600e: 2023-02-19 20:59:58,950 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,950 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:59:58,951 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1/5a8314307d8e4c39ba7d4c04858abbfb] hfiles 2023-02-19 20:59:58,951 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1/5a8314307d8e4c39ba7d4c04858abbfb for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,951 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2/79fa1b0ad9ca4fc298d29ef2e1c47d35] hfiles 2023-02-19 20:59:58,951 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2/79fa1b0ad9ca4fc298d29ef2e1c47d35 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,958 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1/02250848e51348039f4539b335790407, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:59:58,960 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/.tmp/f2/7926389b5636443185dfe9dbc5ec02de as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2/7926389b5636443185dfe9dbc5ec02de 2023-02-19 20:59:58,967 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/.tmp/f1/6ff5f9333afc425d931dafe790872c0a as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1/6ff5f9333afc425d931dafe790872c0a 2023-02-19 20:59:58,972 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2/7926389b5636443185dfe9dbc5ec02de, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:59:58,973 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. completed. 2023-02-19 20:59:58,973 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 20:59:58,973 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 20:59:58,973 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 20:59:58,973 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:58,973 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-19 20:59:58,973 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44193,1676840392492' in zk 2023-02-19 20:59:58,974 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a3fcc2e1ce4d69bbf873de2e300c9446 in 747ms, sequenceid=5, compaction requested=false 2023-02-19 20:59:58,974 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a3fcc2e1ce4d69bbf873de2e300c9446: 2023-02-19 20:59:58,975 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,975 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:59:58,975 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1/02250848e51348039f4539b335790407] hfiles 2023-02-19 20:59:58,975 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1/02250848e51348039f4539b335790407 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,975 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2/7926389b5636443185dfe9dbc5ec02de] hfiles 2023-02-19 20:59:58,975 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2/7926389b5636443185dfe9dbc5ec02de for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,980 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:58,980 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-19 20:59:58,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:58,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:59:58,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:59:58,980 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:59:58,980 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-19 20:59:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:59:58,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:59:58,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:59:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:58,984 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1/6ff5f9333afc425d931dafe790872c0a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:59:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:58,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:59:58,985 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/.tmp/f2/8c632d4e394a4a1f953c4d1057fdf3e3 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2/8c632d4e394a4a1f953c4d1057fdf3e3 2023-02-19 20:59:58,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:59:58,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44193,1676840392492': 2023-02-19 20:59:58,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44193,1676840392492' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-19 20:59:58,993 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2/8c632d4e394a4a1f953c4d1057fdf3e3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:59:58,995 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 8630f5270002fcda4479e320d28f766f in 180ms, sequenceid=5, compaction requested=false 2023-02-19 20:59:58,995 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8630f5270002fcda4479e320d28f766f: 2023-02-19 20:59:58,995 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,995 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:59:58,995 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1/6ff5f9333afc425d931dafe790872c0a] hfiles 2023-02-19 20:59:58,995 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1/6ff5f9333afc425d931dafe790872c0a for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:58,995 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2/8c632d4e394a4a1f953c4d1057fdf3e3] hfiles 2023-02-19 20:59:58,996 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2/8c632d4e394a4a1f953c4d1057fdf3e3 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:59:59,004 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. completed. 2023-02-19 20:59:59,004 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 20:59:59,004 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 20:59:59,015 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. completed. 2023-02-19 20:59:59,015 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 20:59:59,015 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 20:59:59,015 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 20:59:59,015 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:59,015 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-19 20:59:59,015 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40243,1676840392539' in zk 2023-02-19 20:59:59,018 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:59,018 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-19 20:59:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:59:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:59:59,018 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:59:59,019 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-19 20:59:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:59:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:59:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:59:59,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:59,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:59,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:59:59,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:59:59,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:59,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:59,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40243,1676840392539': 2023-02-19 20:59:59,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40243,1676840392539' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-19 20:59:59,024 INFO [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-19 20:59:59,024 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:59:59,024 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:59:59,024 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-19 20:59:59,024 INFO [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 20:59:59,027 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:59,027 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:59,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:59,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:59:59,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:59:59,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:59,027 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:59:59,027 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:59,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:59,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:59,027 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:59:59,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:59,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:59:59,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:59:59,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:59:59,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:59:59,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:59:59,028 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:59,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:59,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:59:59,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:59,029 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:59,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:59:59,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:59:59,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:59:59,031 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:59:59,032 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:59,045 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:59:59,045 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:59,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:59:59,046 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:59:59,046 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:59:59,045 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:59:59,046 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:59:59,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:59:59,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:59:59,046 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-19 20:59:59,046 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:59:59,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-19 20:59:59,046 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:59,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:59:59,047 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:59:59,047 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 20:59:59,047 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:59,047 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 20:59:59,047 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:59:59,047 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:59:59,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:59:59,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:59:59,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:59:59,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:59:59,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-19 20:59:59,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-19 20:59:59,285 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:59:59,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:59:59,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:59:59,288 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-19 20:59:59,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-19 20:59:59,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-19 20:59:59,559 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-19 20:59:59,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676840398152Consolidate snapshot: testWithMapReduceMultiRegion at 1676840399047 (+895 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676840399047Writing data manifest for testWithMapReduceMultiRegion at 1676840399074 (+27 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676840399095 (+21 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676840399558 (+463 ms) 2023-02-19 20:59:59,560 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 20:59:59,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.4050 sec 2023-02-19 21:00:00,288 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:00,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 21:00:00,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 21:00:00,290 INFO [Listener at localhost/38225] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 21:00:00,326 INFO [Listener at localhost/38225] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 21:00:00,338 INFO [Listener at localhost/38225] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 21:00:00,422 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44193] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:00,423 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40243] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:00,546 INFO [Listener at localhost/38225] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 21:00:00,560 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 21:00:00,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-19 21:00:00,566 INFO [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-19 21:00:00,566 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:00,566 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-19 21:00:00,567 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-19 21:00:00,567 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:00,567 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:00,569 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:00,569 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:00,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:00,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:00,569 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:00,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:00,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:00,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:00,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:00,570 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:00,571 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:00,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:00,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:00,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:00,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:00,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:00,572 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 21:00:00,571 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:00,572 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:00,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:00,572 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 21:00:00,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 21:00:00,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 21:00:00,574 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 21:00:00,574 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 21:00:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 21:00:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:00,576 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 21:00:00,576 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:00,577 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. started... 2023-02-19 21:00:00,577 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a3fcc2e1ce4d69bbf873de2e300c9446 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:00,580 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:00,580 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. started... 2023-02-19 21:00:00,580 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8041dbf00f4076cea8295fd209618185 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:00,586 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:00,589 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:00,589 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. started... 2023-02-19 21:00:00,589 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing da0f1e605c2bd617fb518b8c79f1a68d 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 21:00:00,588 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 21:00:00,589 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 21:00:00,592 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 21:00:00,592 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 21:00:00,592 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:00,592 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. started... 2023-02-19 21:00:00,592 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 67561ca3643b847b21dddc9042ae0bef 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:00,586 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:00,589 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. started... 2023-02-19 21:00:00,593 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. started... 2023-02-19 21:00:00,593 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 94a2c01c5633d7fdb30d081febbedbf4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:00,593 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6e7da067f4df0f176a8f374fed05da30 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:00,651 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/.tmp/f1/577c7644eb0a498085a74011b3f4077d 2023-02-19 21:00:00,668 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/.tmp/f1/361813889b7741f2bae327d048399ed7 2023-02-19 21:00:00,683 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/.tmp/f1/e523b72ec0964b53a84e9daef444c2dd 2023-02-19 21:00:00,690 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/.tmp/f1/2b64454b662f401f8fd6d24e2638c299 2023-02-19 21:00:00,693 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/.tmp/f1/ae5f727decab44ff9ec02fd9fef7a50a 2023-02-19 21:00:00,704 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/.tmp/f1/caadddf7b5c64740a6509415dedcbf92 2023-02-19 21:00:00,734 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/.tmp/f2/125df979661e4b1d912083b52d1b6da8 2023-02-19 21:00:00,752 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/.tmp/f2/df4811902c8a45558aa61fdccf479266 2023-02-19 21:00:00,756 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/.tmp/f1/361813889b7741f2bae327d048399ed7 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1/361813889b7741f2bae327d048399ed7 2023-02-19 21:00:00,761 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/.tmp/f2/6a0a976a7cfe4a4da8c5c986fc922f51 2023-02-19 21:00:00,762 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/.tmp/f1/577c7644eb0a498085a74011b3f4077d as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1/577c7644eb0a498085a74011b3f4077d 2023-02-19 21:00:00,767 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/.tmp/f2/e45839291d504e5993968174e1f51a61 2023-02-19 21:00:00,767 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1/361813889b7741f2bae327d048399ed7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:00,767 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/.tmp/f2/9e489039aa004c89b888b798c0158eac 2023-02-19 21:00:00,770 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/.tmp/f2/125df979661e4b1d912083b52d1b6da8 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2/125df979661e4b1d912083b52d1b6da8 2023-02-19 21:00:00,773 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/.tmp/f2/6987c84bf8544131be606ec1080d2711 2023-02-19 21:00:00,774 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/.tmp/f1/e523b72ec0964b53a84e9daef444c2dd as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1/e523b72ec0964b53a84e9daef444c2dd 2023-02-19 21:00:00,778 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1/577c7644eb0a498085a74011b3f4077d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:00,780 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/.tmp/f2/df4811902c8a45558aa61fdccf479266 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2/df4811902c8a45558aa61fdccf479266 2023-02-19 21:00:00,780 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/.tmp/f1/2b64454b662f401f8fd6d24e2638c299 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1/2b64454b662f401f8fd6d24e2638c299 2023-02-19 21:00:00,783 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/.tmp/f1/caadddf7b5c64740a6509415dedcbf92 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1/caadddf7b5c64740a6509415dedcbf92 2023-02-19 21:00:00,783 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/.tmp/f1/ae5f727decab44ff9ec02fd9fef7a50a as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1/ae5f727decab44ff9ec02fd9fef7a50a 2023-02-19 21:00:00,787 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1/e523b72ec0964b53a84e9daef444c2dd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:00,787 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2/125df979661e4b1d912083b52d1b6da8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:00,789 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/.tmp/f2/6a0a976a7cfe4a4da8c5c986fc922f51 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2/6a0a976a7cfe4a4da8c5c986fc922f51 2023-02-19 21:00:00,789 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a3fcc2e1ce4d69bbf873de2e300c9446 in 212ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:00,789 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a3fcc2e1ce4d69bbf873de2e300c9446: 2023-02-19 21:00:00,789 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:00,789 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:00,789 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 21:00:00,789 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. started... 2023-02-19 21:00:00,790 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8630f5270002fcda4479e320d28f766f 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 21:00:00,791 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1/2b64454b662f401f8fd6d24e2638c299, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:00,793 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/.tmp/f2/e45839291d504e5993968174e1f51a61 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2/e45839291d504e5993968174e1f51a61 2023-02-19 21:00:00,796 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1/ae5f727decab44ff9ec02fd9fef7a50a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:00,797 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/.tmp/f2/6987c84bf8544131be606ec1080d2711 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2/6987c84bf8544131be606ec1080d2711 2023-02-19 21:00:00,798 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2/df4811902c8a45558aa61fdccf479266, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:00,800 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8041dbf00f4076cea8295fd209618185 in 220ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:00,800 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8041dbf00f4076cea8295fd209618185: 2023-02-19 21:00:00,800 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:00,803 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2/6a0a976a7cfe4a4da8c5c986fc922f51, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:00,804 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:00,804 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. started... 2023-02-19 21:00:00,804 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 21:00:00,804 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5cb889795a604110c3b2397847de14e3: 2023-02-19 21:00:00,804 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:00,804 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:00,804 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. started... 2023-02-19 21:00:00,804 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 21:00:00,804 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9e298d453970c11026570bf2ed2b600e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:00,804 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 94a2c01c5633d7fdb30d081febbedbf4 in 211ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:00,805 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 94a2c01c5633d7fdb30d081febbedbf4: 2023-02-19 21:00:00,805 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:00,805 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 21:00:00,807 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2/6987c84bf8544131be606ec1080d2711, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:00,807 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2/e45839291d504e5993968174e1f51a61, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:00,808 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 67561ca3643b847b21dddc9042ae0bef in 216ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:00,808 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6e7da067f4df0f176a8f374fed05da30 in 215ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:00,808 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 67561ca3643b847b21dddc9042ae0bef: 2023-02-19 21:00:00,808 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6e7da067f4df0f176a8f374fed05da30: 2023-02-19 21:00:00,809 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1/caadddf7b5c64740a6509415dedcbf92, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 21:00:00,809 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:00,809 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:00,809 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 21:00:00,809 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:00,809 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 21:00:00,809 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. started... 2023-02-19 21:00:00,809 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c5a77ef914048739ee7a1009051b5414: 2023-02-19 21:00:00,809 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:00,809 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 21:00:00,810 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/.tmp/f2/9e489039aa004c89b888b798c0158eac as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2/9e489039aa004c89b888b798c0158eac 2023-02-19 21:00:00,824 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2/9e489039aa004c89b888b798c0158eac, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 21:00:00,825 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for da0f1e605c2bd617fb518b8c79f1a68d in 236ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:00,826 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for da0f1e605c2bd617fb518b8c79f1a68d: 2023-02-19 21:00:00,826 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:00,826 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 21:00:00,829 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-19 21:00:00,837 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/.tmp/f1/28ec1ae2baf84566a42fcea25d9864ba 2023-02-19 21:00:00,844 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/.tmp/f1/0ac623974a684fedafe5e57fc51644cd 2023-02-19 21:00:00,865 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/.tmp/f2/5c5ec1546a0f403eac02b28108648bac 2023-02-19 21:00:00,873 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/.tmp/f1/0ac623974a684fedafe5e57fc51644cd as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1/0ac623974a684fedafe5e57fc51644cd 2023-02-19 21:00:00,880 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1/0ac623974a684fedafe5e57fc51644cd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:00,884 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/.tmp/f2/5c5ec1546a0f403eac02b28108648bac as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2/5c5ec1546a0f403eac02b28108648bac 2023-02-19 21:00:00,892 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2/5c5ec1546a0f403eac02b28108648bac, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:00,893 INFO [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9e298d453970c11026570bf2ed2b600e in 89ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:00,893 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9e298d453970c11026570bf2ed2b600e: 2023-02-19 21:00:00,893 DEBUG [rs(jenkins-hbase4.apache.org,44193,1676840392492)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:00,894 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 21:00:00,894 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 21:00:00,894 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:00,894 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 21:00:00,894 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44193,1676840392492' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 21:00:00,897 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:00,897 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:00,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:00,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:00,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:00,897 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:00,897 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:00,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:00,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44193,1676840392492' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 21:00:00,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37ea0fa5[Count = 1] remaining members to acquire global barrier 2023-02-19 21:00:00,905 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-19 21:00:00,908 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-19 21:00:01,267 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/.tmp/f2/79a4788d57204ca38a0c615d1de5dcee 2023-02-19 21:00:01,275 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/.tmp/f1/28ec1ae2baf84566a42fcea25d9864ba as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1/28ec1ae2baf84566a42fcea25d9864ba 2023-02-19 21:00:01,281 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1/28ec1ae2baf84566a42fcea25d9864ba, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 21:00:01,282 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/.tmp/f2/79a4788d57204ca38a0c615d1de5dcee as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2/79a4788d57204ca38a0c615d1de5dcee 2023-02-19 21:00:01,288 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2/79a4788d57204ca38a0c615d1de5dcee, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 21:00:01,289 INFO [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 8630f5270002fcda4479e320d28f766f in 500ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:01,289 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8630f5270002fcda4479e320d28f766f: 2023-02-19 21:00:01,289 DEBUG [rs(jenkins-hbase4.apache.org,40243,1676840392539)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:01,289 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 21:00:01,289 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 21:00:01,289 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,289 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 21:00:01,289 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40243,1676840392539' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 21:00:01,291 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,291 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:01,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:01,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:01,291 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:01,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:01,292 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:01,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:01,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:01,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:01,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40243,1676840392539' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 21:00:01,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37ea0fa5[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:01,293 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-19 21:00:01,294 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:01,295 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:01,296 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:01,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:01,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:01,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:01,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:01,296 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 21:00:01,296 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 21:00:01,296 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 21:00:01,296 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,296 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40243,1676840392539' in zk 2023-02-19 21:00:01,296 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 21:00:01,296 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44193,1676840392492' in zk 2023-02-19 21:00:01,296 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,296 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:01,299 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 21:00:01,299 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,299 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:01,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,299 DEBUG [member: 'jenkins-hbase4.apache.org,40243,1676840392539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 21:00:01,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:01,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:01,300 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,300 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 21:00:01,300 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:01,300 DEBUG [member: 'jenkins-hbase4.apache.org,44193,1676840392492' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 21:00:01,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:01,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:01,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:01,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:01,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:01,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40243,1676840392539': 2023-02-19 21:00:01,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40243,1676840392539' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-19 21:00:01,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:01,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:01,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:01,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:01,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:01,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:01,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:01,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44193,1676840392492': 2023-02-19 21:00:01,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44193,1676840392492' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-19 21:00:01,308 INFO [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-19 21:00:01,308 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:01,308 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:01,308 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-19 21:00:01,308 INFO [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 21:00:01,311 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:01,311 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:01,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:01,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:01,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:01,311 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:01,311 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:01,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:01,311 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:01,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:01,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:01,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:01,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:01,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:01,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:01,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:01,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:01,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:01,312 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:01,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:01,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:01,312 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:01,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:01,314 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:01,315 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,320 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:01,320 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:01,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:01,320 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:01,320 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:01,320 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:01,320 DEBUG [(jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:01,320 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,320 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-19 21:00:01,321 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 21:00:01,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:01,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:01,320 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:01,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:01,320 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:01,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:01,321 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:01,321 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:01,322 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:01,322 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:01,322 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:01,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:01,323 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:01,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:01,323 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 21:00:01,423 DEBUG [Listener at localhost/38225] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 21:00:01,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 21:00:01,449 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 21:00:01,450 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-19 21:00:01,536 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/hadoop-5389607371752041591.jar 2023-02-19 21:00:01,553 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676840398093 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:01,554 DEBUG [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce 2023-02-19 21:00:01,555 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(239): region to add: 6e7da067f4df0f176a8f374fed05da30 2023-02-19 21:00:01,555 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(239): region to add: a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 21:00:01,555 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(239): region to add: 8041dbf00f4076cea8295fd209618185 2023-02-19 21:00:01,555 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(239): region to add: 94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 21:00:01,555 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(239): region to add: da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 21:00:01,556 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(239): region to add: 67561ca3643b847b21dddc9042ae0bef 2023-02-19 21:00:01,556 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(239): region to add: 8630f5270002fcda4479e320d28f766f 2023-02-19 21:00:01,556 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(239): region to add: 5cb889795a604110c3b2397847de14e3 2023-02-19 21:00:01,556 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(239): region to add: 9e298d453970c11026570bf2ed2b600e 2023-02-19 21:00:01,556 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(239): region to add: c5a77ef914048739ee7a1009051b5414 2023-02-19 21:00:01,556 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(585): clone region=6e7da067f4df0f176a8f374fed05da30 as 6e7da067f4df0f176a8f374fed05da30 in snapshot testWithMapReduceMultiRegion 2023-02-19 21:00:01,556 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(585): clone region=a3fcc2e1ce4d69bbf873de2e300c9446 as a3fcc2e1ce4d69bbf873de2e300c9446 in snapshot testWithMapReduceMultiRegion 2023-02-19 21:00:01,556 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(585): clone region=8041dbf00f4076cea8295fd209618185 as 8041dbf00f4076cea8295fd209618185 in snapshot testWithMapReduceMultiRegion 2023-02-19 21:00:01,557 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(585): clone region=94a2c01c5633d7fdb30d081febbedbf4 as 94a2c01c5633d7fdb30d081febbedbf4 in snapshot testWithMapReduceMultiRegion 2023-02-19 21:00:01,557 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(585): clone region=da0f1e605c2bd617fb518b8c79f1a68d as da0f1e605c2bd617fb518b8c79f1a68d in snapshot testWithMapReduceMultiRegion 2023-02-19 21:00:01,557 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(585): clone region=67561ca3643b847b21dddc9042ae0bef as 67561ca3643b847b21dddc9042ae0bef in snapshot testWithMapReduceMultiRegion 2023-02-19 21:00:01,557 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(585): clone region=8630f5270002fcda4479e320d28f766f as 8630f5270002fcda4479e320d28f766f in snapshot testWithMapReduceMultiRegion 2023-02-19 21:00:01,557 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(585): clone region=5cb889795a604110c3b2397847de14e3 as 5cb889795a604110c3b2397847de14e3 in snapshot testWithMapReduceMultiRegion 2023-02-19 21:00:01,557 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(585): clone region=9e298d453970c11026570bf2ed2b600e as 9e298d453970c11026570bf2ed2b600e in snapshot testWithMapReduceMultiRegion 2023-02-19 21:00:01,557 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(585): clone region=c5a77ef914048739ee7a1009051b5414 as c5a77ef914048739ee7a1009051b5414 in snapshot testWithMapReduceMultiRegion 2023-02-19 21:00:01,562 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8041dbf00f4076cea8295fd209618185, NAME => 'testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c 2023-02-19 21:00:01,562 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => a3fcc2e1ce4d69bbf873de2e300c9446, NAME => 'testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c 2023-02-19 21:00:01,562 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 94a2c01c5633d7fdb30d081febbedbf4, NAME => 'testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c 2023-02-19 21:00:01,563 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 8630f5270002fcda4479e320d28f766f, NAME => 'testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c 2023-02-19 21:00:01,564 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 67561ca3643b847b21dddc9042ae0bef, NAME => 'testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c 2023-02-19 21:00:01,564 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => da0f1e605c2bd617fb518b8c79f1a68d, NAME => 'testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c 2023-02-19 21:00:01,564 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 5cb889795a604110c3b2397847de14e3, NAME => 'testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c 2023-02-19 21:00:01,564 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6e7da067f4df0f176a8f374fed05da30, NAME => 'testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c 2023-02-19 21:00:01,607 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:01,607 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 01b7bf11382f4f67b3d88ee35bbfd663 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,608 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:01,608 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 32c5ee0a926b4bdaa211500dfb51f047 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,616 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:01,616 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2b6f5ba51b534709a24c7557ae706be0 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,622 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c1f191de22d1409d893f40b86e86c933 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,623 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:01,623 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6ff5f9333afc425d931dafe790872c0a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,628 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2d7a73c3796f4305b671edb6cf4dce03 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,631 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:01,631 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 02250848e51348039f4539b335790407 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,640 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:01,640 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b481589f2d2d44dda8f997fe64de66fe from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,641 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing da0f1e605c2bd617fb518b8c79f1a68d, disabling compactions & flushes 2023-02-19 21:00:01,641 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:01,641 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:01,641 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. after waiting 0 ms 2023-02-19 21:00:01,641 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9227e7682d1e4c3ab2bca3fc8809c97c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,641 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:01,642 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:01,642 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for da0f1e605c2bd617fb518b8c79f1a68d: 2023-02-19 21:00:01,643 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 9e298d453970c11026570bf2ed2b600e, NAME => 'testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c 2023-02-19 21:00:01,648 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8c632d4e394a4a1f953c4d1057fdf3e3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,649 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:01,649 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b02ef55326734caeadaf1c60182bbb81 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,651 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c7f8dfde976e40989ead73ee6bc8f5bc from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,651 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7926389b5636443185dfe9dbc5ec02de from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,655 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 67561ca3643b847b21dddc9042ae0bef, disabling compactions & flushes 2023-02-19 21:00:01,655 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:01,655 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:01,656 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. after waiting 0 ms 2023-02-19 21:00:01,656 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:01,656 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:01,656 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:01,656 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 5cb889795a604110c3b2397847de14e3, disabling compactions & flushes 2023-02-19 21:00:01,656 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 67561ca3643b847b21dddc9042ae0bef: 2023-02-19 21:00:01,656 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:01,657 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:01,657 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 94a2c01c5633d7fdb30d081febbedbf4, disabling compactions & flushes 2023-02-19 21:00:01,657 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. after waiting 0 ms 2023-02-19 21:00:01,657 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => c5a77ef914048739ee7a1009051b5414, NAME => 'testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c 2023-02-19 21:00:01,657 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:01,657 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:01,657 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:01,657 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:01,657 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 5cb889795a604110c3b2397847de14e3: 2023-02-19 21:00:01,657 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. after waiting 0 ms 2023-02-19 21:00:01,657 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:01,658 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:01,658 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 94a2c01c5633d7fdb30d081febbedbf4: 2023-02-19 21:00:01,660 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3a4b531cdb32482abf0014cf3059de0e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,660 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing a3fcc2e1ce4d69bbf873de2e300c9446, disabling compactions & flushes 2023-02-19 21:00:01,660 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:01,660 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:01,661 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. after waiting 0 ms 2023-02-19 21:00:01,661 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:01,661 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:01,661 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for a3fcc2e1ce4d69bbf873de2e300c9446: 2023-02-19 21:00:01,687 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 8630f5270002fcda4479e320d28f766f, disabling compactions & flushes 2023-02-19 21:00:01,687 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 8041dbf00f4076cea8295fd209618185, disabling compactions & flushes 2023-02-19 21:00:01,687 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 6e7da067f4df0f176a8f374fed05da30, disabling compactions & flushes 2023-02-19 21:00:01,687 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:01,687 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:01,687 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:01,687 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:01,687 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. after waiting 0 ms 2023-02-19 21:00:01,687 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:01,687 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:01,687 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:01,687 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:01,687 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. after waiting 0 ms 2023-02-19 21:00:01,688 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 8041dbf00f4076cea8295fd209618185: 2023-02-19 21:00:01,687 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. after waiting 0 ms 2023-02-19 21:00:01,688 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:01,688 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:01,688 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 6e7da067f4df0f176a8f374fed05da30: 2023-02-19 21:00:01,688 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:01,688 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:01,688 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 8630f5270002fcda4479e320d28f766f: 2023-02-19 21:00:01,692 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:01,692 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:01,692 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing c5a77ef914048739ee7a1009051b5414, disabling compactions & flushes 2023-02-19 21:00:01,692 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:01,692 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5a8314307d8e4c39ba7d4c04858abbfb from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,692 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:01,692 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. after waiting 0 ms 2023-02-19 21:00:01,692 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:01,692 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:01,692 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for c5a77ef914048739ee7a1009051b5414: 2023-02-19 21:00:01,695 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 79fa1b0ad9ca4fc298d29ef2e1c47d35 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 21:00:01,698 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 9e298d453970c11026570bf2ed2b600e, disabling compactions & flushes 2023-02-19 21:00:01,698 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:01,698 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:01,698 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. after waiting 0 ms 2023-02-19 21:00:01,698 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:01,698 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:01,698 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 9e298d453970c11026570bf2ed2b600e: 2023-02-19 21:00:01,698 INFO [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676840398093 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:01,698 DEBUG [Listener at localhost/38225] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c 2023-02-19 21:00:01,698 DEBUG [Listener at localhost/38225] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c 2023-02-19 21:00:01,699 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-data/ 2023-02-19 21:00:01,700 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |----default/ 2023-02-19 21:00:01,700 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-19 21:00:01,701 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |----------5cb889795a604110c3b2397847de14e3/ 2023-02-19 21:00:01,701 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:01,701 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |----------67561ca3643b847b21dddc9042ae0bef/ 2023-02-19 21:00:01,702 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:01,702 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:01,702 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=67561ca3643b847b21dddc9042ae0bef-32c5ee0a926b4bdaa211500dfb51f047 2023-02-19 21:00:01,702 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:01,703 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=67561ca3643b847b21dddc9042ae0bef-9227e7682d1e4c3ab2bca3fc8809c97c 2023-02-19 21:00:01,703 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |----------6e7da067f4df0f176a8f374fed05da30/ 2023-02-19 21:00:01,703 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:01,704 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:01,704 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=6e7da067f4df0f176a8f374fed05da30-b481589f2d2d44dda8f997fe64de66fe 2023-02-19 21:00:01,704 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:01,705 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=6e7da067f4df0f176a8f374fed05da30-c7f8dfde976e40989ead73ee6bc8f5bc 2023-02-19 21:00:01,705 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |----------8041dbf00f4076cea8295fd209618185/ 2023-02-19 21:00:01,705 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:01,705 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:01,706 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=8041dbf00f4076cea8295fd209618185-b02ef55326734caeadaf1c60182bbb81 2023-02-19 21:00:01,706 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:01,706 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=8041dbf00f4076cea8295fd209618185-3a4b531cdb32482abf0014cf3059de0e 2023-02-19 21:00:01,706 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |----------8630f5270002fcda4479e320d28f766f/ 2023-02-19 21:00:01,707 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:01,707 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:01,708 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=8630f5270002fcda4479e320d28f766f-6ff5f9333afc425d931dafe790872c0a 2023-02-19 21:00:01,708 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:01,708 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=8630f5270002fcda4479e320d28f766f-8c632d4e394a4a1f953c4d1057fdf3e3 2023-02-19 21:00:01,708 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |----------94a2c01c5633d7fdb30d081febbedbf4/ 2023-02-19 21:00:01,709 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:01,709 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:01,709 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=94a2c01c5633d7fdb30d081febbedbf4-2b6f5ba51b534709a24c7557ae706be0 2023-02-19 21:00:01,709 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:01,710 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=94a2c01c5633d7fdb30d081febbedbf4-2d7a73c3796f4305b671edb6cf4dce03 2023-02-19 21:00:01,710 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |----------9e298d453970c11026570bf2ed2b600e/ 2023-02-19 21:00:01,711 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:01,711 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:01,711 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=9e298d453970c11026570bf2ed2b600e-5a8314307d8e4c39ba7d4c04858abbfb 2023-02-19 21:00:01,711 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:01,712 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=9e298d453970c11026570bf2ed2b600e-79fa1b0ad9ca4fc298d29ef2e1c47d35 2023-02-19 21:00:01,712 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |----------a3fcc2e1ce4d69bbf873de2e300c9446/ 2023-02-19 21:00:01,712 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:01,712 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:01,713 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=a3fcc2e1ce4d69bbf873de2e300c9446-02250848e51348039f4539b335790407 2023-02-19 21:00:01,713 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:01,713 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=a3fcc2e1ce4d69bbf873de2e300c9446-7926389b5636443185dfe9dbc5ec02de 2023-02-19 21:00:01,713 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |----------c5a77ef914048739ee7a1009051b5414/ 2023-02-19 21:00:01,714 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:01,714 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |----------da0f1e605c2bd617fb518b8c79f1a68d/ 2023-02-19 21:00:01,714 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:01,714 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:01,715 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=da0f1e605c2bd617fb518b8c79f1a68d-01b7bf11382f4f67b3d88ee35bbfd663 2023-02-19 21:00:01,715 DEBUG [Listener at localhost/38225] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:01,715 DEBUG [Listener at localhost/38225] util.CommonFSUtils(702): |----------------testWithMapReduce=da0f1e605c2bd617fb518b8c79f1a68d-c1f191de22d1409d893f40b86e86c933 2023-02-19 21:00:01,724 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:01,724 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:01,725 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:01,725 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:02,706 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/hadoop-6501025382687160962.jar 2023-02-19 21:00:02,707 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:02,707 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:02,779 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/hadoop-1184824835073270057.jar 2023-02-19 21:00:02,779 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:02,780 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:02,780 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:02,781 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:02,781 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:02,782 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:02,783 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-19 21:00:02,783 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-19 21:00:02,784 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-19 21:00:02,784 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-19 21:00:02,784 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-19 21:00:02,785 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-19 21:00:02,785 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-19 21:00:02,786 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-19 21:00:02,786 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-19 21:00:02,787 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-19 21:00:02,793 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:02,793 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 21:00:02,794 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 21:00:02,795 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 21:00:02,795 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 21:00:02,867 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/hadoop-8389306278445167033.jar 2023-02-19 21:00:02,868 DEBUG [Listener at localhost/38225] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 21:00:02,934 WARN [Listener at localhost/38225] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-19 21:00:02,957 WARN [Listener at localhost/38225] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-19 21:00:02,978 INFO [Listener at localhost/38225] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 21:00:03,373 WARN [Listener at localhost/38225] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/mapreduce.cluster.local.dir/1676840403293/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-19 21:00:03,373 WARN [Listener at localhost/38225] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/mapreduce.cluster.local.dir/1676840403293/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-19 21:00:03,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:03,587 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:03,589 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:03,595 INFO [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6e7da067f4df0f176a8f374fed05da30 2023-02-19 21:00:03,597 DEBUG [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1 2023-02-19 21:00:03,598 INFO [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e7da067f4df0f176a8f374fed05da30 columnFamilyName f1 2023-02-19 21:00:03,608 DEBUG [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1/testWithMapReduce=6e7da067f4df0f176a8f374fed05da30-b481589f2d2d44dda8f997fe64de66fe 2023-02-19 21:00:03,608 INFO [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] regionserver.HStore(310): Store=6e7da067f4df0f176a8f374fed05da30/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:03,608 INFO [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6e7da067f4df0f176a8f374fed05da30 2023-02-19 21:00:03,610 DEBUG [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2 2023-02-19 21:00:03,610 INFO [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e7da067f4df0f176a8f374fed05da30 columnFamilyName f2 2023-02-19 21:00:03,618 DEBUG [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2/testWithMapReduce=6e7da067f4df0f176a8f374fed05da30-c7f8dfde976e40989ead73ee6bc8f5bc 2023-02-19 21:00:03,618 INFO [StoreOpener-6e7da067f4df0f176a8f374fed05da30-1] regionserver.HStore(310): Store=6e7da067f4df0f176a8f374fed05da30/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:03,619 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:03,619 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6e7da067f4df0f176a8f374fed05da30; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64403814, jitterRate=-0.0403083860874176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:03,619 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6e7da067f4df0f176a8f374fed05da30: 2023-02-19 21:00:03,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6e7da067f4df0f176a8f374fed05da30, disabling compactions & flushes 2023-02-19 21:00:03,839 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:03,840 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:03,840 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. after waiting 0 ms 2023-02-19 21:00:03,840 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:03,857 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:03,857 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6e7da067f4df0f176a8f374fed05da30: 2023-02-19 21:00:03,875 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:03,875 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:03,880 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:03,882 INFO [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 67561ca3643b847b21dddc9042ae0bef 2023-02-19 21:00:03,883 DEBUG [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1 2023-02-19 21:00:03,883 INFO [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67561ca3643b847b21dddc9042ae0bef columnFamilyName f1 2023-02-19 21:00:03,907 DEBUG [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1/testWithMapReduce=67561ca3643b847b21dddc9042ae0bef-32c5ee0a926b4bdaa211500dfb51f047 2023-02-19 21:00:03,907 INFO [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] regionserver.HStore(310): Store=67561ca3643b847b21dddc9042ae0bef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:03,907 INFO [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 67561ca3643b847b21dddc9042ae0bef 2023-02-19 21:00:03,908 DEBUG [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2 2023-02-19 21:00:03,909 INFO [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67561ca3643b847b21dddc9042ae0bef columnFamilyName f2 2023-02-19 21:00:03,921 DEBUG [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2/testWithMapReduce=67561ca3643b847b21dddc9042ae0bef-9227e7682d1e4c3ab2bca3fc8809c97c 2023-02-19 21:00:03,921 INFO [StoreOpener-67561ca3643b847b21dddc9042ae0bef-1] regionserver.HStore(310): Store=67561ca3643b847b21dddc9042ae0bef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:03,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:03,922 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 67561ca3643b847b21dddc9042ae0bef; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75428074, jitterRate=0.12396588921546936}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:03,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 67561ca3643b847b21dddc9042ae0bef: 2023-02-19 21:00:03,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 67561ca3643b847b21dddc9042ae0bef, disabling compactions & flushes 2023-02-19 21:00:03,977 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:03,978 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:03,978 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. after waiting 0 ms 2023-02-19 21:00:03,978 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:03,987 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:03,987 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 67561ca3643b847b21dddc9042ae0bef: 2023-02-19 21:00:04,014 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:04,014 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:04,024 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:04,029 INFO [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 21:00:04,030 DEBUG [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1 2023-02-19 21:00:04,030 INFO [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94a2c01c5633d7fdb30d081febbedbf4 columnFamilyName f1 2023-02-19 21:00:04,056 DEBUG [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1/testWithMapReduce=94a2c01c5633d7fdb30d081febbedbf4-2b6f5ba51b534709a24c7557ae706be0 2023-02-19 21:00:04,057 INFO [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] regionserver.HStore(310): Store=94a2c01c5633d7fdb30d081febbedbf4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,057 INFO [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 21:00:04,059 DEBUG [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2 2023-02-19 21:00:04,060 INFO [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94a2c01c5633d7fdb30d081febbedbf4 columnFamilyName f2 2023-02-19 21:00:04,075 DEBUG [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2/testWithMapReduce=94a2c01c5633d7fdb30d081febbedbf4-2d7a73c3796f4305b671edb6cf4dce03 2023-02-19 21:00:04,075 INFO [StoreOpener-94a2c01c5633d7fdb30d081febbedbf4-1] regionserver.HStore(310): Store=94a2c01c5633d7fdb30d081febbedbf4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,076 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:04,076 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 94a2c01c5633d7fdb30d081febbedbf4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69559542, jitterRate=0.036517947912216187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:04,076 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 94a2c01c5633d7fdb30d081febbedbf4: 2023-02-19 21:00:04,166 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 94a2c01c5633d7fdb30d081febbedbf4, disabling compactions & flushes 2023-02-19 21:00:04,166 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:04,167 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:04,168 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. after waiting 0 ms 2023-02-19 21:00:04,168 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:04,171 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:04,171 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 94a2c01c5633d7fdb30d081febbedbf4: 2023-02-19 21:00:04,177 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:04,177 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:04,181 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:04,184 INFO [StoreOpener-8630f5270002fcda4479e320d28f766f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8630f5270002fcda4479e320d28f766f 2023-02-19 21:00:04,186 DEBUG [StoreOpener-8630f5270002fcda4479e320d28f766f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1 2023-02-19 21:00:04,186 INFO [StoreOpener-8630f5270002fcda4479e320d28f766f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8630f5270002fcda4479e320d28f766f columnFamilyName f1 2023-02-19 21:00:04,198 DEBUG [StoreOpener-8630f5270002fcda4479e320d28f766f-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1/testWithMapReduce=8630f5270002fcda4479e320d28f766f-6ff5f9333afc425d931dafe790872c0a 2023-02-19 21:00:04,198 INFO [StoreOpener-8630f5270002fcda4479e320d28f766f-1] regionserver.HStore(310): Store=8630f5270002fcda4479e320d28f766f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,199 INFO [StoreOpener-8630f5270002fcda4479e320d28f766f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8630f5270002fcda4479e320d28f766f 2023-02-19 21:00:04,200 DEBUG [StoreOpener-8630f5270002fcda4479e320d28f766f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2 2023-02-19 21:00:04,200 INFO [StoreOpener-8630f5270002fcda4479e320d28f766f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8630f5270002fcda4479e320d28f766f columnFamilyName f2 2023-02-19 21:00:04,208 DEBUG [StoreOpener-8630f5270002fcda4479e320d28f766f-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2/testWithMapReduce=8630f5270002fcda4479e320d28f766f-8c632d4e394a4a1f953c4d1057fdf3e3 2023-02-19 21:00:04,208 INFO [StoreOpener-8630f5270002fcda4479e320d28f766f-1] regionserver.HStore(310): Store=8630f5270002fcda4479e320d28f766f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,209 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:04,209 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8630f5270002fcda4479e320d28f766f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68844923, jitterRate=0.025869295001029968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:04,209 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8630f5270002fcda4479e320d28f766f: 2023-02-19 21:00:04,273 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8630f5270002fcda4479e320d28f766f, disabling compactions & flushes 2023-02-19 21:00:04,273 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:04,273 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:04,273 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. after waiting 0 ms 2023-02-19 21:00:04,273 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:04,276 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:04,276 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8630f5270002fcda4479e320d28f766f: 2023-02-19 21:00:04,282 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:04,282 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:04,283 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:04,300 INFO [StoreOpener-8041dbf00f4076cea8295fd209618185-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8041dbf00f4076cea8295fd209618185 2023-02-19 21:00:04,306 DEBUG [StoreOpener-8041dbf00f4076cea8295fd209618185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1 2023-02-19 21:00:04,307 INFO [StoreOpener-8041dbf00f4076cea8295fd209618185-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8041dbf00f4076cea8295fd209618185 columnFamilyName f1 2023-02-19 21:00:04,321 DEBUG [StoreOpener-8041dbf00f4076cea8295fd209618185-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1/testWithMapReduce=8041dbf00f4076cea8295fd209618185-b02ef55326734caeadaf1c60182bbb81 2023-02-19 21:00:04,321 INFO [StoreOpener-8041dbf00f4076cea8295fd209618185-1] regionserver.HStore(310): Store=8041dbf00f4076cea8295fd209618185/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,321 INFO [StoreOpener-8041dbf00f4076cea8295fd209618185-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8041dbf00f4076cea8295fd209618185 2023-02-19 21:00:04,323 DEBUG [StoreOpener-8041dbf00f4076cea8295fd209618185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2 2023-02-19 21:00:04,323 INFO [StoreOpener-8041dbf00f4076cea8295fd209618185-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8041dbf00f4076cea8295fd209618185 columnFamilyName f2 2023-02-19 21:00:04,350 DEBUG [StoreOpener-8041dbf00f4076cea8295fd209618185-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2/testWithMapReduce=8041dbf00f4076cea8295fd209618185-3a4b531cdb32482abf0014cf3059de0e 2023-02-19 21:00:04,351 INFO [StoreOpener-8041dbf00f4076cea8295fd209618185-1] regionserver.HStore(310): Store=8041dbf00f4076cea8295fd209618185/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,351 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:04,351 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8041dbf00f4076cea8295fd209618185; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64117825, jitterRate=-0.0445699542760849}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:04,351 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8041dbf00f4076cea8295fd209618185: 2023-02-19 21:00:04,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8041dbf00f4076cea8295fd209618185, disabling compactions & flushes 2023-02-19 21:00:04,394 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:04,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:04,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. after waiting 0 ms 2023-02-19 21:00:04,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:04,429 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:04,429 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8041dbf00f4076cea8295fd209618185: 2023-02-19 21:00:04,447 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:04,448 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:04,455 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:04,458 INFO [StoreOpener-5cb889795a604110c3b2397847de14e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5cb889795a604110c3b2397847de14e3 2023-02-19 21:00:04,463 DEBUG [StoreOpener-5cb889795a604110c3b2397847de14e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/f1 2023-02-19 21:00:04,463 INFO [StoreOpener-5cb889795a604110c3b2397847de14e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cb889795a604110c3b2397847de14e3 columnFamilyName f1 2023-02-19 21:00:04,464 INFO [StoreOpener-5cb889795a604110c3b2397847de14e3-1] regionserver.HStore(310): Store=5cb889795a604110c3b2397847de14e3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,464 INFO [StoreOpener-5cb889795a604110c3b2397847de14e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5cb889795a604110c3b2397847de14e3 2023-02-19 21:00:04,466 DEBUG [StoreOpener-5cb889795a604110c3b2397847de14e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/f2 2023-02-19 21:00:04,466 INFO [StoreOpener-5cb889795a604110c3b2397847de14e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cb889795a604110c3b2397847de14e3 columnFamilyName f2 2023-02-19 21:00:04,467 INFO [StoreOpener-5cb889795a604110c3b2397847de14e3-1] regionserver.HStore(310): Store=5cb889795a604110c3b2397847de14e3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,467 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:04,467 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5cb889795a604110c3b2397847de14e3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65028797, jitterRate=-0.030995413661003113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:04,467 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5cb889795a604110c3b2397847de14e3: 2023-02-19 21:00:04,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5cb889795a604110c3b2397847de14e3, disabling compactions & flushes 2023-02-19 21:00:04,490 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:04,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:04,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. after waiting 0 ms 2023-02-19 21:00:04,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:04,490 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:04,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5cb889795a604110c3b2397847de14e3: 2023-02-19 21:00:04,494 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:04,495 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:04,498 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:04,500 INFO [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c5a77ef914048739ee7a1009051b5414 2023-02-19 21:00:04,501 DEBUG [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/f1 2023-02-19 21:00:04,502 INFO [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5a77ef914048739ee7a1009051b5414 columnFamilyName f1 2023-02-19 21:00:04,503 INFO [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] regionserver.HStore(310): Store=c5a77ef914048739ee7a1009051b5414/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,503 INFO [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c5a77ef914048739ee7a1009051b5414 2023-02-19 21:00:04,504 DEBUG [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/f2 2023-02-19 21:00:04,505 INFO [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5a77ef914048739ee7a1009051b5414 columnFamilyName f2 2023-02-19 21:00:04,505 INFO [StoreOpener-c5a77ef914048739ee7a1009051b5414-1] regionserver.HStore(310): Store=c5a77ef914048739ee7a1009051b5414/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,505 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:04,505 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c5a77ef914048739ee7a1009051b5414; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61724955, jitterRate=-0.08022649586200714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:04,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c5a77ef914048739ee7a1009051b5414: 2023-02-19 21:00:04,546 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c5a77ef914048739ee7a1009051b5414, disabling compactions & flushes 2023-02-19 21:00:04,546 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:04,546 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:04,546 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. after waiting 0 ms 2023-02-19 21:00:04,546 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:04,547 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:04,547 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c5a77ef914048739ee7a1009051b5414: 2023-02-19 21:00:04,554 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:04,554 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:04,557 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:04,559 INFO [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 21:00:04,560 DEBUG [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1 2023-02-19 21:00:04,560 INFO [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da0f1e605c2bd617fb518b8c79f1a68d columnFamilyName f1 2023-02-19 21:00:04,573 DEBUG [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1/testWithMapReduce=da0f1e605c2bd617fb518b8c79f1a68d-01b7bf11382f4f67b3d88ee35bbfd663 2023-02-19 21:00:04,574 INFO [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] regionserver.HStore(310): Store=da0f1e605c2bd617fb518b8c79f1a68d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,574 INFO [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 21:00:04,576 DEBUG [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2 2023-02-19 21:00:04,577 INFO [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da0f1e605c2bd617fb518b8c79f1a68d columnFamilyName f2 2023-02-19 21:00:04,586 DEBUG [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2/testWithMapReduce=da0f1e605c2bd617fb518b8c79f1a68d-c1f191de22d1409d893f40b86e86c933 2023-02-19 21:00:04,586 INFO [StoreOpener-da0f1e605c2bd617fb518b8c79f1a68d-1] regionserver.HStore(310): Store=da0f1e605c2bd617fb518b8c79f1a68d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,586 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:04,587 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened da0f1e605c2bd617fb518b8c79f1a68d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61956364, jitterRate=-0.07677823305130005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:04,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for da0f1e605c2bd617fb518b8c79f1a68d: 2023-02-19 21:00:04,628 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing da0f1e605c2bd617fb518b8c79f1a68d, disabling compactions & flushes 2023-02-19 21:00:04,628 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:04,628 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:04,628 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. after waiting 0 ms 2023-02-19 21:00:04,628 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:04,641 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:04,641 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for da0f1e605c2bd617fb518b8c79f1a68d: 2023-02-19 21:00:04,646 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:04,646 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:04,653 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:04,659 INFO [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9e298d453970c11026570bf2ed2b600e 2023-02-19 21:00:04,661 DEBUG [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1 2023-02-19 21:00:04,661 INFO [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e298d453970c11026570bf2ed2b600e columnFamilyName f1 2023-02-19 21:00:04,670 DEBUG [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1/testWithMapReduce=9e298d453970c11026570bf2ed2b600e-5a8314307d8e4c39ba7d4c04858abbfb 2023-02-19 21:00:04,670 INFO [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] regionserver.HStore(310): Store=9e298d453970c11026570bf2ed2b600e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,670 INFO [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9e298d453970c11026570bf2ed2b600e 2023-02-19 21:00:04,671 DEBUG [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2 2023-02-19 21:00:04,671 INFO [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e298d453970c11026570bf2ed2b600e columnFamilyName f2 2023-02-19 21:00:04,678 DEBUG [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2/testWithMapReduce=9e298d453970c11026570bf2ed2b600e-79fa1b0ad9ca4fc298d29ef2e1c47d35 2023-02-19 21:00:04,679 INFO [StoreOpener-9e298d453970c11026570bf2ed2b600e-1] regionserver.HStore(310): Store=9e298d453970c11026570bf2ed2b600e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,679 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:04,679 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9e298d453970c11026570bf2ed2b600e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62126784, jitterRate=-0.07423877716064453}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:04,679 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9e298d453970c11026570bf2ed2b600e: 2023-02-19 21:00:04,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9e298d453970c11026570bf2ed2b600e, disabling compactions & flushes 2023-02-19 21:00:04,707 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:04,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:04,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. after waiting 0 ms 2023-02-19 21:00:04,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:04,711 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:04,711 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9e298d453970c11026570bf2ed2b600e: 2023-02-19 21:00:04,714 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:04,714 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:04,720 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:04,721 INFO [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 21:00:04,722 DEBUG [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1 2023-02-19 21:00:04,723 INFO [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3fcc2e1ce4d69bbf873de2e300c9446 columnFamilyName f1 2023-02-19 21:00:04,728 DEBUG [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1/testWithMapReduce=a3fcc2e1ce4d69bbf873de2e300c9446-02250848e51348039f4539b335790407 2023-02-19 21:00:04,729 INFO [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] regionserver.HStore(310): Store=a3fcc2e1ce4d69bbf873de2e300c9446/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,729 INFO [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 21:00:04,730 DEBUG [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2 2023-02-19 21:00:04,730 INFO [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3fcc2e1ce4d69bbf873de2e300c9446 columnFamilyName f2 2023-02-19 21:00:04,737 DEBUG [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] regionserver.HStore(539): loaded hdfs://localhost:39245/user/jenkins/test-data/dfc021d9-1820-6d59-92ee-73e79081b3cb/testWithMapReduceMultiRegion/1faaa295-796f-4feb-9613-da8fe879836c/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2/testWithMapReduce=a3fcc2e1ce4d69bbf873de2e300c9446-7926389b5636443185dfe9dbc5ec02de 2023-02-19 21:00:04,737 INFO [StoreOpener-a3fcc2e1ce4d69bbf873de2e300c9446-1] regionserver.HStore(310): Store=a3fcc2e1ce4d69bbf873de2e300c9446/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:04,737 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:04,737 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a3fcc2e1ce4d69bbf873de2e300c9446; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73558257, jitterRate=0.09610344469547272}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:04,737 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a3fcc2e1ce4d69bbf873de2e300c9446: 2023-02-19 21:00:04,773 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a3fcc2e1ce4d69bbf873de2e300c9446, disabling compactions & flushes 2023-02-19 21:00:04,774 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:04,774 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:04,774 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. after waiting 0 ms 2023-02-19 21:00:04,774 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:04,777 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:04,777 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a3fcc2e1ce4d69bbf873de2e300c9446: 2023-02-19 21:00:05,480 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-19 21:00:05,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-19 21:00:05,497 INFO [Listener at localhost/38225] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 21:00:05,498 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 21:00:05,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-19 21:00:05,513 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840405513"}]},"ts":"1676840405513"} 2023-02-19 21:00:05,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 21:00:05,516 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-19 21:00:05,518 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-19 21:00:05,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c5a77ef914048739ee7a1009051b5414, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8630f5270002fcda4479e320d28f766f, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=94a2c01c5633d7fdb30d081febbedbf4, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9e298d453970c11026570bf2ed2b600e, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6e7da067f4df0f176a8f374fed05da30, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8041dbf00f4076cea8295fd209618185, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a3fcc2e1ce4d69bbf873de2e300c9446, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=67561ca3643b847b21dddc9042ae0bef, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=da0f1e605c2bd617fb518b8c79f1a68d, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5cb889795a604110c3b2397847de14e3, UNASSIGN}] 2023-02-19 21:00:05,530 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5cb889795a604110c3b2397847de14e3, UNASSIGN 2023-02-19 21:00:05,530 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a3fcc2e1ce4d69bbf873de2e300c9446, UNASSIGN 2023-02-19 21:00:05,531 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8041dbf00f4076cea8295fd209618185, UNASSIGN 2023-02-19 21:00:05,531 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=da0f1e605c2bd617fb518b8c79f1a68d, UNASSIGN 2023-02-19 21:00:05,531 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=67561ca3643b847b21dddc9042ae0bef, UNASSIGN 2023-02-19 21:00:05,532 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=5cb889795a604110c3b2397847de14e3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:05,532 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a3fcc2e1ce4d69bbf873de2e300c9446, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:05,533 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840405532"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840405532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840405532"}]},"ts":"1676840405532"} 2023-02-19 21:00:05,533 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405532"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840405532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840405532"}]},"ts":"1676840405532"} 2023-02-19 21:00:05,536 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=da0f1e605c2bd617fb518b8c79f1a68d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:05,537 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405536"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840405536"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840405536"}]},"ts":"1676840405536"} 2023-02-19 21:00:05,537 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=67561ca3643b847b21dddc9042ae0bef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:05,537 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405537"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840405537"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840405537"}]},"ts":"1676840405537"} 2023-02-19 21:00:05,539 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=8041dbf00f4076cea8295fd209618185, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:05,539 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676840396402.8041dbf00f4076cea8295fd209618185.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405539"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840405539"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840405539"}]},"ts":"1676840405539"} 2023-02-19 21:00:05,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE; CloseRegionProcedure 5cb889795a604110c3b2397847de14e3, server=jenkins-hbase4.apache.org,44193,1676840392492}] 2023-02-19 21:00:05,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=40, state=RUNNABLE; CloseRegionProcedure a3fcc2e1ce4d69bbf873de2e300c9446, server=jenkins-hbase4.apache.org,40243,1676840392539}] 2023-02-19 21:00:05,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=42, state=RUNNABLE; CloseRegionProcedure da0f1e605c2bd617fb518b8c79f1a68d, server=jenkins-hbase4.apache.org,44193,1676840392492}] 2023-02-19 21:00:05,552 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=41, state=RUNNABLE; CloseRegionProcedure 67561ca3643b847b21dddc9042ae0bef, server=jenkins-hbase4.apache.org,40243,1676840392539}] 2023-02-19 21:00:05,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=39, state=RUNNABLE; CloseRegionProcedure 8041dbf00f4076cea8295fd209618185, server=jenkins-hbase4.apache.org,44193,1676840392492}] 2023-02-19 21:00:05,554 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6e7da067f4df0f176a8f374fed05da30, UNASSIGN 2023-02-19 21:00:05,555 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9e298d453970c11026570bf2ed2b600e, UNASSIGN 2023-02-19 21:00:05,556 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=94a2c01c5633d7fdb30d081febbedbf4, UNASSIGN 2023-02-19 21:00:05,557 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6e7da067f4df0f176a8f374fed05da30, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:05,557 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840405557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840405557"}]},"ts":"1676840405557"} 2023-02-19 21:00:05,558 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9e298d453970c11026570bf2ed2b600e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:05,558 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405558"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840405558"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840405558"}]},"ts":"1676840405558"} 2023-02-19 21:00:05,559 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=94a2c01c5633d7fdb30d081febbedbf4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:05,559 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405559"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840405559"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840405559"}]},"ts":"1676840405559"} 2023-02-19 21:00:05,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure 6e7da067f4df0f176a8f374fed05da30, server=jenkins-hbase4.apache.org,40243,1676840392539}] 2023-02-19 21:00:05,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 9e298d453970c11026570bf2ed2b600e, server=jenkins-hbase4.apache.org,44193,1676840392492}] 2023-02-19 21:00:05,561 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8630f5270002fcda4479e320d28f766f, UNASSIGN 2023-02-19 21:00:05,562 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure 94a2c01c5633d7fdb30d081febbedbf4, server=jenkins-hbase4.apache.org,44193,1676840392492}] 2023-02-19 21:00:05,562 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c5a77ef914048739ee7a1009051b5414, UNASSIGN 2023-02-19 21:00:05,564 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=8630f5270002fcda4479e320d28f766f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:05,564 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405564"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840405564"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840405564"}]},"ts":"1676840405564"} 2023-02-19 21:00:05,566 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=c5a77ef914048739ee7a1009051b5414, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:05,566 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840405566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840405566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840405566"}]},"ts":"1676840405566"} 2023-02-19 21:00:05,569 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 8630f5270002fcda4479e320d28f766f, server=jenkins-hbase4.apache.org,40243,1676840392539}] 2023-02-19 21:00:05,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure c5a77ef914048739ee7a1009051b5414, server=jenkins-hbase4.apache.org,40243,1676840392539}] 2023-02-19 21:00:05,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 21:00:05,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 67561ca3643b847b21dddc9042ae0bef 2023-02-19 21:00:05,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 67561ca3643b847b21dddc9042ae0bef, disabling compactions & flushes 2023-02-19 21:00:05,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:05,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5cb889795a604110c3b2397847de14e3 2023-02-19 21:00:05,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:05,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5cb889795a604110c3b2397847de14e3, disabling compactions & flushes 2023-02-19 21:00:05,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. after waiting 0 ms 2023-02-19 21:00:05,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:05,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:05,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:05,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. after waiting 0 ms 2023-02-19 21:00:05,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:05,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:05,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 21:00:05,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef. 2023-02-19 21:00:05,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 67561ca3643b847b21dddc9042ae0bef: 2023-02-19 21:00:05,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3. 2023-02-19 21:00:05,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5cb889795a604110c3b2397847de14e3: 2023-02-19 21:00:05,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 67561ca3643b847b21dddc9042ae0bef 2023-02-19 21:00:05,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8630f5270002fcda4479e320d28f766f 2023-02-19 21:00:05,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8630f5270002fcda4479e320d28f766f, disabling compactions & flushes 2023-02-19 21:00:05,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:05,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:05,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. after waiting 0 ms 2023-02-19 21:00:05,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:05,725 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=67561ca3643b847b21dddc9042ae0bef, regionState=CLOSED 2023-02-19 21:00:05,725 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405725"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840405725"}]},"ts":"1676840405725"} 2023-02-19 21:00:05,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5cb889795a604110c3b2397847de14e3 2023-02-19 21:00:05,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8041dbf00f4076cea8295fd209618185 2023-02-19 21:00:05,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8041dbf00f4076cea8295fd209618185, disabling compactions & flushes 2023-02-19 21:00:05,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:05,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:05,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. after waiting 0 ms 2023-02-19 21:00:05,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:05,726 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=5cb889795a604110c3b2397847de14e3, regionState=CLOSED 2023-02-19 21:00:05,726 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840405726"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840405726"}]},"ts":"1676840405726"} 2023-02-19 21:00:05,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=41 2023-02-19 21:00:05,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=41, state=SUCCESS; CloseRegionProcedure 67561ca3643b847b21dddc9042ae0bef, server=jenkins-hbase4.apache.org,40243,1676840392539 in 176 msec 2023-02-19 21:00:05,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-19 21:00:05,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; CloseRegionProcedure 5cb889795a604110c3b2397847de14e3, server=jenkins-hbase4.apache.org,44193,1676840392492 in 188 msec 2023-02-19 21:00:05,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=67561ca3643b847b21dddc9042ae0bef, UNASSIGN in 210 msec 2023-02-19 21:00:05,734 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5cb889795a604110c3b2397847de14e3, UNASSIGN in 209 msec 2023-02-19 21:00:05,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:05,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:05,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f. 2023-02-19 21:00:05,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8630f5270002fcda4479e320d28f766f: 2023-02-19 21:00:05,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185. 2023-02-19 21:00:05,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8041dbf00f4076cea8295fd209618185: 2023-02-19 21:00:05,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8041dbf00f4076cea8295fd209618185 2023-02-19 21:00:05,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9e298d453970c11026570bf2ed2b600e 2023-02-19 21:00:05,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9e298d453970c11026570bf2ed2b600e, disabling compactions & flushes 2023-02-19 21:00:05,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:05,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:05,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. after waiting 0 ms 2023-02-19 21:00:05,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:05,754 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=8041dbf00f4076cea8295fd209618185, regionState=CLOSED 2023-02-19 21:00:05,754 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676840396402.8041dbf00f4076cea8295fd209618185.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405754"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840405754"}]},"ts":"1676840405754"} 2023-02-19 21:00:05,757 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=8630f5270002fcda4479e320d28f766f, regionState=CLOSED 2023-02-19 21:00:05,757 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405757"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840405757"}]},"ts":"1676840405757"} 2023-02-19 21:00:05,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8630f5270002fcda4479e320d28f766f 2023-02-19 21:00:05,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 21:00:05,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a3fcc2e1ce4d69bbf873de2e300c9446, disabling compactions & flushes 2023-02-19 21:00:05,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:05,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:05,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. after waiting 0 ms 2023-02-19 21:00:05,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:05,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=39 2023-02-19 21:00:05,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=39, state=SUCCESS; CloseRegionProcedure 8041dbf00f4076cea8295fd209618185, server=jenkins-hbase4.apache.org,44193,1676840392492 in 208 msec 2023-02-19 21:00:05,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-19 21:00:05,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 8630f5270002fcda4479e320d28f766f, server=jenkins-hbase4.apache.org,40243,1676840392539 in 193 msec 2023-02-19 21:00:05,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8041dbf00f4076cea8295fd209618185, UNASSIGN in 249 msec 2023-02-19 21:00:05,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8630f5270002fcda4479e320d28f766f, UNASSIGN in 252 msec 2023-02-19 21:00:05,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:05,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e. 2023-02-19 21:00:05,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9e298d453970c11026570bf2ed2b600e: 2023-02-19 21:00:05,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9e298d453970c11026570bf2ed2b600e 2023-02-19 21:00:05,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 21:00:05,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 94a2c01c5633d7fdb30d081febbedbf4, disabling compactions & flushes 2023-02-19 21:00:05,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:05,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:05,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. after waiting 0 ms 2023-02-19 21:00:05,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:05,787 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9e298d453970c11026570bf2ed2b600e, regionState=CLOSED 2023-02-19 21:00:05,787 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840405787"}]},"ts":"1676840405787"} 2023-02-19 21:00:05,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:05,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446. 2023-02-19 21:00:05,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a3fcc2e1ce4d69bbf873de2e300c9446: 2023-02-19 21:00:05,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 21:00:05,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6e7da067f4df0f176a8f374fed05da30 2023-02-19 21:00:05,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6e7da067f4df0f176a8f374fed05da30, disabling compactions & flushes 2023-02-19 21:00:05,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:05,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:05,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. after waiting 0 ms 2023-02-19 21:00:05,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:05,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-19 21:00:05,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 9e298d453970c11026570bf2ed2b600e, server=jenkins-hbase4.apache.org,44193,1676840392492 in 230 msec 2023-02-19 21:00:05,799 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a3fcc2e1ce4d69bbf873de2e300c9446, regionState=CLOSED 2023-02-19 21:00:05,799 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840405799"}]},"ts":"1676840405799"} 2023-02-19 21:00:05,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9e298d453970c11026570bf2ed2b600e, UNASSIGN in 278 msec 2023-02-19 21:00:05,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=40 2023-02-19 21:00:05,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=40, state=SUCCESS; CloseRegionProcedure a3fcc2e1ce4d69bbf873de2e300c9446, server=jenkins-hbase4.apache.org,40243,1676840392539 in 254 msec 2023-02-19 21:00:05,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a3fcc2e1ce4d69bbf873de2e300c9446, UNASSIGN in 284 msec 2023-02-19 21:00:05,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:05,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4. 2023-02-19 21:00:05,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 94a2c01c5633d7fdb30d081febbedbf4: 2023-02-19 21:00:05,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:05,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30. 2023-02-19 21:00:05,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6e7da067f4df0f176a8f374fed05da30: 2023-02-19 21:00:05,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 21:00:05,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 21:00:05,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 21:00:05,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing da0f1e605c2bd617fb518b8c79f1a68d, disabling compactions & flushes 2023-02-19 21:00:05,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:05,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:05,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. after waiting 0 ms 2023-02-19 21:00:05,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:05,833 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=94a2c01c5633d7fdb30d081febbedbf4, regionState=CLOSED 2023-02-19 21:00:05,833 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405833"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840405833"}]},"ts":"1676840405833"} 2023-02-19 21:00:05,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6e7da067f4df0f176a8f374fed05da30 2023-02-19 21:00:05,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c5a77ef914048739ee7a1009051b5414 2023-02-19 21:00:05,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c5a77ef914048739ee7a1009051b5414, disabling compactions & flushes 2023-02-19 21:00:05,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:05,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:05,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. after waiting 0 ms 2023-02-19 21:00:05,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:05,835 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6e7da067f4df0f176a8f374fed05da30, regionState=CLOSED 2023-02-19 21:00:05,835 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405835"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840405835"}]},"ts":"1676840405835"} 2023-02-19 21:00:05,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-19 21:00:05,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-19 21:00:05,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure 6e7da067f4df0f176a8f374fed05da30, server=jenkins-hbase4.apache.org,40243,1676840392539 in 278 msec 2023-02-19 21:00:05,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure 94a2c01c5633d7fdb30d081febbedbf4, server=jenkins-hbase4.apache.org,44193,1676840392492 in 274 msec 2023-02-19 21:00:05,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6e7da067f4df0f176a8f374fed05da30, UNASSIGN in 323 msec 2023-02-19 21:00:05,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=94a2c01c5633d7fdb30d081febbedbf4, UNASSIGN in 323 msec 2023-02-19 21:00:05,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 21:00:05,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414. 2023-02-19 21:00:05,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c5a77ef914048739ee7a1009051b5414: 2023-02-19 21:00:05,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c5a77ef914048739ee7a1009051b5414 2023-02-19 21:00:05,896 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=c5a77ef914048739ee7a1009051b5414, regionState=CLOSED 2023-02-19 21:00:05,897 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840405896"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840405896"}]},"ts":"1676840405896"} 2023-02-19 21:00:05,902 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-19 21:00:05,902 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure c5a77ef914048739ee7a1009051b5414, server=jenkins-hbase4.apache.org,40243,1676840392539 in 327 msec 2023-02-19 21:00:05,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c5a77ef914048739ee7a1009051b5414, UNASSIGN in 382 msec 2023-02-19 21:00:05,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:05,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d. 2023-02-19 21:00:05,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for da0f1e605c2bd617fb518b8c79f1a68d: 2023-02-19 21:00:05,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 21:00:05,918 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=da0f1e605c2bd617fb518b8c79f1a68d, regionState=CLOSED 2023-02-19 21:00:05,919 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840405918"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840405918"}]},"ts":"1676840405918"} 2023-02-19 21:00:05,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=42 2023-02-19 21:00:05,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=42, state=SUCCESS; CloseRegionProcedure da0f1e605c2bd617fb518b8c79f1a68d, server=jenkins-hbase4.apache.org,44193,1676840392492 in 371 msec 2023-02-19 21:00:05,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=33 2023-02-19 21:00:05,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=da0f1e605c2bd617fb518b8c79f1a68d, UNASSIGN in 400 msec 2023-02-19 21:00:05,926 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840405926"}]},"ts":"1676840405926"} 2023-02-19 21:00:05,928 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-19 21:00:05,930 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-19 21:00:05,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 431 msec 2023-02-19 21:00:06,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 21:00:06,123 INFO [Listener at localhost/38225] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-19 21:00:06,129 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-19 21:00:06,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-19 21:00:06,148 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 21:00:06,151 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 21:00:06,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 21:00:06,169 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414 2023-02-19 21:00:06,169 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 21:00:06,169 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30 2023-02-19 21:00:06,169 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185 2023-02-19 21:00:06,169 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e 2023-02-19 21:00:06,170 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 21:00:06,170 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef 2023-02-19 21:00:06,169 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f 2023-02-19 21:00:06,174 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/recovered.edits] 2023-02-19 21:00:06,175 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/recovered.edits] 2023-02-19 21:00:06,175 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/recovered.edits] 2023-02-19 21:00:06,177 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/f1, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/f2, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/recovered.edits] 2023-02-19 21:00:06,180 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/recovered.edits] 2023-02-19 21:00:06,180 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/recovered.edits] 2023-02-19 21:00:06,181 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/recovered.edits] 2023-02-19 21:00:06,182 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/recovered.edits] 2023-02-19 21:00:06,189 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1/0ac623974a684fedafe5e57fc51644cd to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1/0ac623974a684fedafe5e57fc51644cd 2023-02-19 21:00:06,201 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1/577c7644eb0a498085a74011b3f4077d to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1/577c7644eb0a498085a74011b3f4077d 2023-02-19 21:00:06,202 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1/2b64454b662f401f8fd6d24e2638c299 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1/2b64454b662f401f8fd6d24e2638c299 2023-02-19 21:00:06,207 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1/5a8314307d8e4c39ba7d4c04858abbfb to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f1/5a8314307d8e4c39ba7d4c04858abbfb 2023-02-19 21:00:06,208 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1/28ec1ae2baf84566a42fcea25d9864ba to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1/28ec1ae2baf84566a42fcea25d9864ba 2023-02-19 21:00:06,208 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1/b02ef55326734caeadaf1c60182bbb81 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f1/b02ef55326734caeadaf1c60182bbb81 2023-02-19 21:00:06,208 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1/02250848e51348039f4539b335790407 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1/02250848e51348039f4539b335790407 2023-02-19 21:00:06,209 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1/b481589f2d2d44dda8f997fe64de66fe to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f1/b481589f2d2d44dda8f997fe64de66fe 2023-02-19 21:00:06,209 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/recovered.edits/6.seqid to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414/recovered.edits/6.seqid 2023-02-19 21:00:06,210 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1/32c5ee0a926b4bdaa211500dfb51f047 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1/32c5ee0a926b4bdaa211500dfb51f047 2023-02-19 21:00:06,210 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1/2b6f5ba51b534709a24c7557ae706be0 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1/2b6f5ba51b534709a24c7557ae706be0 2023-02-19 21:00:06,211 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/c5a77ef914048739ee7a1009051b5414 2023-02-19 21:00:06,211 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 21:00:06,213 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1/e523b72ec0964b53a84e9daef444c2dd to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f1/e523b72ec0964b53a84e9daef444c2dd 2023-02-19 21:00:06,214 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1/6ff5f9333afc425d931dafe790872c0a to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f1/6ff5f9333afc425d931dafe790872c0a 2023-02-19 21:00:06,216 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1/ae5f727decab44ff9ec02fd9fef7a50a to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f1/ae5f727decab44ff9ec02fd9fef7a50a 2023-02-19 21:00:06,217 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1/361813889b7741f2bae327d048399ed7 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f1/361813889b7741f2bae327d048399ed7 2023-02-19 21:00:06,219 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/recovered.edits] 2023-02-19 21:00:06,220 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2/5c5ec1546a0f403eac02b28108648bac to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2/5c5ec1546a0f403eac02b28108648bac 2023-02-19 21:00:06,220 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2/3a4b531cdb32482abf0014cf3059de0e to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2/3a4b531cdb32482abf0014cf3059de0e 2023-02-19 21:00:06,221 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2/c7f8dfde976e40989ead73ee6bc8f5bc to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2/c7f8dfde976e40989ead73ee6bc8f5bc 2023-02-19 21:00:06,225 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2/79fa1b0ad9ca4fc298d29ef2e1c47d35 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/f2/79fa1b0ad9ca4fc298d29ef2e1c47d35 2023-02-19 21:00:06,226 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2/2d7a73c3796f4305b671edb6cf4dce03 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2/2d7a73c3796f4305b671edb6cf4dce03 2023-02-19 21:00:06,226 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2/e45839291d504e5993968174e1f51a61 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/f2/e45839291d504e5993968174e1f51a61 2023-02-19 21:00:06,227 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2/79a4788d57204ca38a0c615d1de5dcee to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2/79a4788d57204ca38a0c615d1de5dcee 2023-02-19 21:00:06,227 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2/df4811902c8a45558aa61fdccf479266 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/f2/df4811902c8a45558aa61fdccf479266 2023-02-19 21:00:06,229 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2/6987c84bf8544131be606ec1080d2711 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2/6987c84bf8544131be606ec1080d2711 2023-02-19 21:00:06,229 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2/125df979661e4b1d912083b52d1b6da8 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2/125df979661e4b1d912083b52d1b6da8 2023-02-19 21:00:06,230 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2/6a0a976a7cfe4a4da8c5c986fc922f51 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/f2/6a0a976a7cfe4a4da8c5c986fc922f51 2023-02-19 21:00:06,233 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2/8c632d4e394a4a1f953c4d1057fdf3e3 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/f2/8c632d4e394a4a1f953c4d1057fdf3e3 2023-02-19 21:00:06,234 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2/9227e7682d1e4c3ab2bca3fc8809c97c to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/f2/9227e7682d1e4c3ab2bca3fc8809c97c 2023-02-19 21:00:06,234 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2/7926389b5636443185dfe9dbc5ec02de to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/f2/7926389b5636443185dfe9dbc5ec02de 2023-02-19 21:00:06,234 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1/01b7bf11382f4f67b3d88ee35bbfd663 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1/01b7bf11382f4f67b3d88ee35bbfd663 2023-02-19 21:00:06,235 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/recovered.edits/12.seqid to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e/recovered.edits/12.seqid 2023-02-19 21:00:06,235 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/recovered.edits/12.seqid to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30/recovered.edits/12.seqid 2023-02-19 21:00:06,237 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/9e298d453970c11026570bf2ed2b600e 2023-02-19 21:00:06,237 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3 2023-02-19 21:00:06,237 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/6e7da067f4df0f176a8f374fed05da30 2023-02-19 21:00:06,238 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/recovered.edits/12.seqid to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185/recovered.edits/12.seqid 2023-02-19 21:00:06,239 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8041dbf00f4076cea8295fd209618185 2023-02-19 21:00:06,239 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1/caadddf7b5c64740a6509415dedcbf92 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f1/caadddf7b5c64740a6509415dedcbf92 2023-02-19 21:00:06,240 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/recovered.edits/12.seqid to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4/recovered.edits/12.seqid 2023-02-19 21:00:06,241 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/f1, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/f2, FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/recovered.edits] 2023-02-19 21:00:06,242 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/94a2c01c5633d7fdb30d081febbedbf4 2023-02-19 21:00:06,242 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/recovered.edits/12.seqid to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f/recovered.edits/12.seqid 2023-02-19 21:00:06,243 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/8630f5270002fcda4479e320d28f766f 2023-02-19 21:00:06,243 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/recovered.edits/12.seqid to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef/recovered.edits/12.seqid 2023-02-19 21:00:06,244 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/recovered.edits/12.seqid to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446/recovered.edits/12.seqid 2023-02-19 21:00:06,244 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/67561ca3643b847b21dddc9042ae0bef 2023-02-19 21:00:06,245 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/a3fcc2e1ce4d69bbf873de2e300c9446 2023-02-19 21:00:06,246 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2/9e489039aa004c89b888b798c0158eac to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2/9e489039aa004c89b888b798c0158eac 2023-02-19 21:00:06,248 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2/c1f191de22d1409d893f40b86e86c933 to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/f2/c1f191de22d1409d893f40b86e86c933 2023-02-19 21:00:06,251 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/recovered.edits/6.seqid to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3/recovered.edits/6.seqid 2023-02-19 21:00:06,251 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/5cb889795a604110c3b2397847de14e3 2023-02-19 21:00:06,253 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/recovered.edits/12.seqid to hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/archive/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d/recovered.edits/12.seqid 2023-02-19 21:00:06,254 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/.tmp/data/default/testWithMapReduce/da0f1e605c2bd617fb518b8c79f1a68d 2023-02-19 21:00:06,254 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 21:00:06,261 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 21:00:06,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 21:00:06,286 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-19 21:00:06,290 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-19 21:00:06,292 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 21:00:06,292 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-19 21:00:06,292 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840406292"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:06,292 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840406292"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:06,292 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840406292"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:06,292 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840406292"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:06,292 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840406292"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:06,292 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676840396402.8041dbf00f4076cea8295fd209618185.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840406292"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:06,292 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840406292"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:06,292 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840406292"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:06,293 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840406292"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:06,293 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840406292"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:06,295 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-19 21:00:06,295 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c5a77ef914048739ee7a1009051b5414, NAME => 'testWithMapReduce,,1676840396402.c5a77ef914048739ee7a1009051b5414.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 8630f5270002fcda4479e320d28f766f, NAME => 'testWithMapReduce,aaa,1676840396402.8630f5270002fcda4479e320d28f766f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 94a2c01c5633d7fdb30d081febbedbf4, NAME => 'testWithMapReduce,d\x84\x84,1676840396402.94a2c01c5633d7fdb30d081febbedbf4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 9e298d453970c11026570bf2ed2b600e, NAME => 'testWithMapReduce,g\xA7\xA7,1676840396402.9e298d453970c11026570bf2ed2b600e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 6e7da067f4df0f176a8f374fed05da30, NAME => 'testWithMapReduce,j\xCA\xCA,1676840396402.6e7da067f4df0f176a8f374fed05da30.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 8041dbf00f4076cea8295fd209618185, NAME => 'testWithMapReduce,m\xED\xED,1676840396402.8041dbf00f4076cea8295fd209618185.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => a3fcc2e1ce4d69bbf873de2e300c9446, NAME => 'testWithMapReduce,q\x11\x10,1676840396402.a3fcc2e1ce4d69bbf873de2e300c9446.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 67561ca3643b847b21dddc9042ae0bef, NAME => 'testWithMapReduce,t43,1676840396402.67561ca3643b847b21dddc9042ae0bef.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => da0f1e605c2bd617fb518b8c79f1a68d, NAME => 'testWithMapReduce,wWV,1676840396402.da0f1e605c2bd617fb518b8c79f1a68d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 5cb889795a604110c3b2397847de14e3, NAME => 'testWithMapReduce,zz{,1676840396402.5cb889795a604110c3b2397847de14e3.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-19 21:00:06,295 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-19 21:00:06,296 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676840406295"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:06,297 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-19 21:00:06,300 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 21:00:06,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 170 msec 2023-02-19 21:00:06,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 21:00:06,465 INFO [Listener at localhost/38225] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-19 21:00:06,465 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 21:00:06,465 INFO [Listener at localhost/38225] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 21:00:06,465 DEBUG [Listener at localhost/38225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x682ed554 to 127.0.0.1:50373 2023-02-19 21:00:06,465 DEBUG [Listener at localhost/38225] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:06,465 DEBUG [Listener at localhost/38225] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 21:00:06,466 DEBUG [Listener at localhost/38225] util.JVMClusterUtil(257): Found active master hash=392371017, stopped=false 2023-02-19 21:00:06,466 INFO [Listener at localhost/38225] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40927,1676840391295 2023-02-19 21:00:06,469 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:06,469 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:06,469 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:06,470 INFO [Listener at localhost/38225] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 21:00:06,470 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:06,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:06,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:06,471 DEBUG [Listener at localhost/38225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00bc10b2 to 127.0.0.1:50373 2023-02-19 21:00:06,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:06,471 DEBUG [Listener at localhost/38225] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:06,472 INFO [Listener at localhost/38225] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44193,1676840392492' ***** 2023-02-19 21:00:06,472 INFO [Listener at localhost/38225] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:06,472 INFO [Listener at localhost/38225] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40243,1676840392539' ***** 2023-02-19 21:00:06,472 INFO [Listener at localhost/38225] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:06,472 INFO [RS:0;jenkins-hbase4:44193] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:06,472 INFO [RS:1;jenkins-hbase4:40243] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:06,472 INFO [RS:1;jenkins-hbase4:40243] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:06,472 INFO [RS:0;jenkins-hbase4:44193] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:06,472 INFO [RS:1;jenkins-hbase4:40243] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:06,472 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:06,473 INFO [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:06,472 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:06,473 DEBUG [RS:1;jenkins-hbase4:40243] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52e07816 to 127.0.0.1:50373 2023-02-19 21:00:06,473 DEBUG [RS:1;jenkins-hbase4:40243] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:06,472 INFO [RS:0;jenkins-hbase4:44193] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:06,473 INFO [RS:1;jenkins-hbase4:40243] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:06,474 INFO [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(3304): Received CLOSE for 0d1379743a81dc7c6cf58d2a42b2489b 2023-02-19 21:00:06,474 INFO [RS:1;jenkins-hbase4:40243] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:06,474 INFO [RS:1;jenkins-hbase4:40243] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:06,474 INFO [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 21:00:06,474 INFO [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:06,474 DEBUG [RS:0;jenkins-hbase4:44193] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e97d46e to 127.0.0.1:50373 2023-02-19 21:00:06,474 DEBUG [RS:0;jenkins-hbase4:44193] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:06,474 INFO [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 21:00:06,474 INFO [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 21:00:06,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0d1379743a81dc7c6cf58d2a42b2489b, disabling compactions & flushes 2023-02-19 21:00:06,475 DEBUG [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1479): Online Regions={0d1379743a81dc7c6cf58d2a42b2489b=hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b.} 2023-02-19 21:00:06,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. 2023-02-19 21:00:06,475 DEBUG [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-19 21:00:06,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. 2023-02-19 21:00:06,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. after waiting 0 ms 2023-02-19 21:00:06,476 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:06,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. 2023-02-19 21:00:06,476 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:06,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 0d1379743a81dc7c6cf58d2a42b2489b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 21:00:06,476 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:06,476 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:06,476 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:06,476 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-19 21:00:06,477 DEBUG [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1505): Waiting on 0d1379743a81dc7c6cf58d2a42b2489b 2023-02-19 21:00:06,479 DEBUG [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 21:00:06,479 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:06,482 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:06,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b/.tmp/info/1d4eb2f93122442b8d838139ec9c8e03 2023-02-19 21:00:06,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b/.tmp/info/1d4eb2f93122442b8d838139ec9c8e03 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b/info/1d4eb2f93122442b8d838139ec9c8e03 2023-02-19 21:00:06,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b/info/1d4eb2f93122442b8d838139ec9c8e03, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 21:00:06,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0d1379743a81dc7c6cf58d2a42b2489b in 50ms, sequenceid=6, compaction requested=false 2023-02-19 21:00:06,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/namespace/0d1379743a81dc7c6cf58d2a42b2489b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 21:00:06,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. 2023-02-19 21:00:06,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0d1379743a81dc7c6cf58d2a42b2489b: 2023-02-19 21:00:06,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676840395500.0d1379743a81dc7c6cf58d2a42b2489b. 2023-02-19 21:00:06,677 INFO [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44193,1676840392492; all regions closed. 2023-02-19 21:00:06,679 DEBUG [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 21:00:06,687 DEBUG [RS:0;jenkins-hbase4:44193] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/oldWALs 2023-02-19 21:00:06,687 INFO [RS:0;jenkins-hbase4:44193] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44193%2C1676840392492:(num 1676840395933) 2023-02-19 21:00:06,687 DEBUG [RS:0;jenkins-hbase4:44193] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:06,687 INFO [RS:0;jenkins-hbase4:44193] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:06,687 INFO [RS:0;jenkins-hbase4:44193] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:06,688 INFO [RS:0;jenkins-hbase4:44193] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:06,688 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:06,688 INFO [RS:0;jenkins-hbase4:44193] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:06,688 INFO [RS:0;jenkins-hbase4:44193] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:06,689 INFO [RS:0;jenkins-hbase4:44193] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44193 2023-02-19 21:00:06,697 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:06,697 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:06,697 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:06,697 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44193,1676840392492 2023-02-19 21:00:06,697 ERROR [Listener at localhost/38225-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@44dbe0a0 rejected from java.util.concurrent.ThreadPoolExecutor@40e47ce3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:06,697 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:06,697 ERROR [Listener at localhost/38225-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2fecd53b rejected from java.util.concurrent.ThreadPoolExecutor@40e47ce3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:06,697 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44193,1676840392492] 2023-02-19 21:00:06,698 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44193,1676840392492; numProcessing=1 2023-02-19 21:00:06,699 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44193,1676840392492 already deleted, retry=false 2023-02-19 21:00:06,700 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44193,1676840392492 expired; onlineServers=1 2023-02-19 21:00:06,866 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 21:00:06,866 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 21:00:06,879 DEBUG [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 21:00:06,907 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/.tmp/info/9c3657e072e445158d54e1d46a697403 2023-02-19 21:00:06,916 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c3657e072e445158d54e1d46a697403 2023-02-19 21:00:06,929 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/.tmp/rep_barrier/2dd6a2058d4449c6872f55f1175bf50c 2023-02-19 21:00:06,944 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dd6a2058d4449c6872f55f1175bf50c 2023-02-19 21:00:06,955 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/.tmp/table/9493545d3cd447d2b8b96e9cb75bda2d 2023-02-19 21:00:06,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9493545d3cd447d2b8b96e9cb75bda2d 2023-02-19 21:00:06,961 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/.tmp/info/9c3657e072e445158d54e1d46a697403 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/info/9c3657e072e445158d54e1d46a697403 2023-02-19 21:00:06,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c3657e072e445158d54e1d46a697403 2023-02-19 21:00:06,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/info/9c3657e072e445158d54e1d46a697403, entries=30, sequenceid=57, filesize=7.9 K 2023-02-19 21:00:06,969 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/.tmp/rep_barrier/2dd6a2058d4449c6872f55f1175bf50c as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/rep_barrier/2dd6a2058d4449c6872f55f1175bf50c 2023-02-19 21:00:06,973 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:06,973 INFO [RS:0;jenkins-hbase4:44193] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44193,1676840392492; zookeeper connection closed. 2023-02-19 21:00:06,973 ERROR [Listener at localhost/38225-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@57c98f84 rejected from java.util.concurrent.ThreadPoolExecutor@40e47ce3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:06,973 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:44193-0x1006e61b8a40001, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:06,973 ERROR [Listener at localhost/38225-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2cc5515b rejected from java.util.concurrent.ThreadPoolExecutor@40e47ce3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:06,974 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@52ba948a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@52ba948a 2023-02-19 21:00:06,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dd6a2058d4449c6872f55f1175bf50c 2023-02-19 21:00:06,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/rep_barrier/2dd6a2058d4449c6872f55f1175bf50c, entries=10, sequenceid=57, filesize=5.9 K 2023-02-19 21:00:06,977 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/.tmp/table/9493545d3cd447d2b8b96e9cb75bda2d as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/table/9493545d3cd447d2b8b96e9cb75bda2d 2023-02-19 21:00:06,982 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9493545d3cd447d2b8b96e9cb75bda2d 2023-02-19 21:00:06,982 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/table/9493545d3cd447d2b8b96e9cb75bda2d, entries=13, sequenceid=57, filesize=5.9 K 2023-02-19 21:00:06,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 507ms, sequenceid=57, compaction requested=false 2023-02-19 21:00:06,992 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-19 21:00:06,993 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 21:00:06,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:06,994 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:06,994 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:07,079 INFO [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40243,1676840392539; all regions closed. 2023-02-19 21:00:07,086 DEBUG [RS:1;jenkins-hbase4:40243] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/oldWALs 2023-02-19 21:00:07,086 INFO [RS:1;jenkins-hbase4:40243] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40243%2C1676840392539.meta:.meta(num 1676840395232) 2023-02-19 21:00:07,095 DEBUG [RS:1;jenkins-hbase4:40243] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/oldWALs 2023-02-19 21:00:07,095 INFO [RS:1;jenkins-hbase4:40243] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40243%2C1676840392539:(num 1676840395934) 2023-02-19 21:00:07,095 DEBUG [RS:1;jenkins-hbase4:40243] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:07,095 INFO [RS:1;jenkins-hbase4:40243] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:07,096 INFO [RS:1;jenkins-hbase4:40243] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:07,096 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:07,100 INFO [RS:1;jenkins-hbase4:40243] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40243 2023-02-19 21:00:07,103 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:07,103 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40243,1676840392539 2023-02-19 21:00:07,103 ERROR [Listener at localhost/38225-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f06eb5d rejected from java.util.concurrent.ThreadPoolExecutor@1b396c65[Terminated, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:07,104 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40243,1676840392539] 2023-02-19 21:00:07,104 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40243,1676840392539; numProcessing=2 2023-02-19 21:00:07,106 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40243,1676840392539 already deleted, retry=false 2023-02-19 21:00:07,106 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40243,1676840392539 expired; onlineServers=0 2023-02-19 21:00:07,106 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40927,1676840391295' ***** 2023-02-19 21:00:07,106 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 21:00:07,107 DEBUG [M:0;jenkins-hbase4:40927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@565e1172, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:07,107 INFO [M:0;jenkins-hbase4:40927] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40927,1676840391295 2023-02-19 21:00:07,107 INFO [M:0;jenkins-hbase4:40927] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40927,1676840391295; all regions closed. 2023-02-19 21:00:07,107 DEBUG [M:0;jenkins-hbase4:40927] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:07,107 DEBUG [M:0;jenkins-hbase4:40927] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 21:00:07,107 DEBUG [M:0;jenkins-hbase4:40927] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 21:00:07,107 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 21:00:07,108 INFO [M:0;jenkins-hbase4:40927] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 21:00:07,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840393740] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840393740,5,FailOnTimeoutGroup] 2023-02-19 21:00:07,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840393738] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840393738,5,FailOnTimeoutGroup] 2023-02-19 21:00:07,108 INFO [M:0;jenkins-hbase4:40927] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 21:00:07,109 INFO [M:0;jenkins-hbase4:40927] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 21:00:07,109 DEBUG [M:0;jenkins-hbase4:40927] master.HMaster(1512): Stopping service threads 2023-02-19 21:00:07,109 INFO [M:0;jenkins-hbase4:40927] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 21:00:07,110 ERROR [M:0;jenkins-hbase4:40927] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-19 21:00:07,111 INFO [M:0;jenkins-hbase4:40927] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 21:00:07,112 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 21:00:07,113 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:07,114 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:07,114 DEBUG [M:0;jenkins-hbase4:40927] zookeeper.ZKUtil(398): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 21:00:07,114 WARN [M:0;jenkins-hbase4:40927] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 21:00:07,114 INFO [M:0;jenkins-hbase4:40927] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 21:00:07,114 INFO [M:0;jenkins-hbase4:40927] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 21:00:07,115 DEBUG [M:0;jenkins-hbase4:40927] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:07,115 INFO [M:0;jenkins-hbase4:40927] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:07,115 DEBUG [M:0;jenkins-hbase4:40927] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:07,115 DEBUG [M:0;jenkins-hbase4:40927] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:07,115 DEBUG [M:0;jenkins-hbase4:40927] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:07,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:07,115 INFO [M:0;jenkins-hbase4:40927] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.23 KB heapSize=192.16 KB 2023-02-19 21:00:07,140 INFO [M:0;jenkins-hbase4:40927] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.23 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/16d4c1e45192448c9f488e59c48c1252 2023-02-19 21:00:07,146 DEBUG [M:0;jenkins-hbase4:40927] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/16d4c1e45192448c9f488e59c48c1252 as hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/16d4c1e45192448c9f488e59c48c1252 2023-02-19 21:00:07,151 INFO [M:0;jenkins-hbase4:40927] regionserver.HStore(1080): Added hdfs://localhost:39245/user/jenkins/test-data/2270d174-430b-7ed1-d1ee-3bbc7c2d9c53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/16d4c1e45192448c9f488e59c48c1252, entries=53, sequenceid=357, filesize=10.4 K 2023-02-19 21:00:07,152 INFO [M:0;jenkins-hbase4:40927] regionserver.HRegion(2947): Finished flush of dataSize ~159.23 KB/163052, heapSize ~192.14 KB/196752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 37ms, sequenceid=357, compaction requested=false 2023-02-19 21:00:07,157 INFO [M:0;jenkins-hbase4:40927] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:07,157 DEBUG [M:0;jenkins-hbase4:40927] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:07,162 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:07,162 INFO [M:0;jenkins-hbase4:40927] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 21:00:07,188 INFO [M:0;jenkins-hbase4:40927] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40927 2023-02-19 21:00:07,191 DEBUG [M:0;jenkins-hbase4:40927] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40927,1676840391295 already deleted, retry=false 2023-02-19 21:00:07,206 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:07,206 INFO [RS:1;jenkins-hbase4:40243] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40243,1676840392539; zookeeper connection closed. 2023-02-19 21:00:07,206 ERROR [Listener at localhost/38225-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@475bbc1b rejected from java.util.concurrent.ThreadPoolExecutor@1b396c65[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:07,206 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): regionserver:40243-0x1006e61b8a40002, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:07,206 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3449b6d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3449b6d 2023-02-19 21:00:07,206 ERROR [Listener at localhost/38225-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3fa5f86a rejected from java.util.concurrent.ThreadPoolExecutor@1b396c65[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:07,207 INFO [Listener at localhost/38225] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 21:00:07,306 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:07,306 INFO [M:0;jenkins-hbase4:40927] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40927,1676840391295; zookeeper connection closed. 2023-02-19 21:00:07,306 ERROR [Listener at localhost/38225-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35dfed0b rejected from java.util.concurrent.ThreadPoolExecutor@685b3beb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:07,306 DEBUG [Listener at localhost/38225-EventThread] zookeeper.ZKWatcher(600): master:40927-0x1006e61b8a40000, quorum=127.0.0.1:50373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:07,307 ERROR [Listener at localhost/38225-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@8178ebd rejected from java.util.concurrent.ThreadPoolExecutor@685b3beb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:07,309 WARN [Listener at localhost/38225] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:07,314 INFO [Listener at localhost/38225] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:07,419 WARN [BP-2054697711-172.31.14.131-1676840387574 heartbeating to localhost/127.0.0.1:39245] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:07,419 WARN [BP-2054697711-172.31.14.131-1676840387574 heartbeating to localhost/127.0.0.1:39245] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2054697711-172.31.14.131-1676840387574 (Datanode Uuid ea3edb84-e1cd-49fc-a840-9e350ebd223c) service to localhost/127.0.0.1:39245 2023-02-19 21:00:07,421 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/cluster_94f2c487-2a40-0be8-3e02-be44caac612f/dfs/data/data3/current/BP-2054697711-172.31.14.131-1676840387574] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:07,422 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/cluster_94f2c487-2a40-0be8-3e02-be44caac612f/dfs/data/data4/current/BP-2054697711-172.31.14.131-1676840387574] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:07,424 WARN [Listener at localhost/38225] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:07,427 INFO [Listener at localhost/38225] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:07,533 WARN [BP-2054697711-172.31.14.131-1676840387574 heartbeating to localhost/127.0.0.1:39245] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:07,534 WARN [BP-2054697711-172.31.14.131-1676840387574 heartbeating to localhost/127.0.0.1:39245] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2054697711-172.31.14.131-1676840387574 (Datanode Uuid f65165bb-6a94-4777-a1c8-21414b415d39) service to localhost/127.0.0.1:39245 2023-02-19 21:00:07,534 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/cluster_94f2c487-2a40-0be8-3e02-be44caac612f/dfs/data/data1/current/BP-2054697711-172.31.14.131-1676840387574] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:07,535 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/cluster_94f2c487-2a40-0be8-3e02-be44caac612f/dfs/data/data2/current/BP-2054697711-172.31.14.131-1676840387574] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:07,575 INFO [Listener at localhost/38225] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:07,704 INFO [Listener at localhost/38225] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 21:00:07,794 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 21:00:07,810 INFO [Listener at localhost/38225] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:39245 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:39245 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38225 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:39245 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:39245 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:39245 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:39245 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39245 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40927,1676840391295)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@1478f372 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=542 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=365 (was 268) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=9720 (was 11370) 2023-02-19 21:00:07,821 INFO [Listener at localhost/38225] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=542, MaxFileDescriptor=60000, SystemLoadAverage=365, ProcessCount=172, AvailableMemoryMB=9719 2023-02-19 21:00:07,836 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/hadoop.log.dir so I do NOT create it in target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3 2023-02-19 21:00:07,837 WARN [Listener at localhost/38225] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 21:00:07,837 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/hadoop.tmp.dir so I do NOT create it in target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3 2023-02-19 21:00:07,837 WARN [Listener at localhost/38225] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4744597a-1683-b551-559e-b1a9a9b76d8d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 21:00:07,837 DEBUG [Listener at localhost/38225] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3 2023-02-19 21:00:07,837 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 21:00:07,837 INFO [Listener at localhost/38225] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/cluster_158ecc85-7faa-e6d3-042e-f6f1c86f3a3d, deleteOnExit=true 2023-02-19 21:00:07,837 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 21:00:07,838 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/test.cache.data in system properties and HBase conf 2023-02-19 21:00:07,838 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 21:00:07,838 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/hadoop.log.dir in system properties and HBase conf 2023-02-19 21:00:07,838 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 21:00:07,838 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 21:00:07,838 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 21:00:07,838 DEBUG [Listener at localhost/38225] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 21:00:07,839 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 21:00:07,839 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 21:00:07,839 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 21:00:07,840 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 21:00:07,840 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 21:00:07,840 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 21:00:07,840 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 21:00:07,840 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 21:00:07,840 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 21:00:07,841 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/nfs.dump.dir in system properties and HBase conf 2023-02-19 21:00:07,841 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/java.io.tmpdir in system properties and HBase conf 2023-02-19 21:00:07,841 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 21:00:07,841 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 21:00:07,841 INFO [Listener at localhost/38225] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 21:00:07,846 WARN [Listener at localhost/38225] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 21:00:07,846 WARN [Listener at localhost/38225] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 21:00:08,723 WARN [Listener at localhost/38225] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:08,725 INFO [Listener at localhost/38225] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:08,732 INFO [Listener at localhost/38225] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/java.io.tmpdir/Jetty_localhost_39777_hdfs____.g8wo4l/webapp 2023-02-19 21:00:08,835 INFO [Listener at localhost/38225] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39777 2023-02-19 21:00:08,839 WARN [Listener at localhost/38225] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 21:00:08,839 WARN [Listener at localhost/38225] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 21:00:09,677 WARN [Listener at localhost/43691] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:09,690 WARN [Listener at localhost/43691] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 21:00:09,692 WARN [Listener at localhost/43691] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:09,693 INFO [Listener at localhost/43691] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:09,699 INFO [Listener at localhost/43691] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/java.io.tmpdir/Jetty_localhost_33021_datanode____evuxkm/webapp 2023-02-19 21:00:09,791 INFO [Listener at localhost/43691] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33021 2023-02-19 21:00:09,798 WARN [Listener at localhost/38727] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:09,810 WARN [Listener at localhost/38727] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 21:00:09,812 WARN [Listener at localhost/38727] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:09,813 INFO [Listener at localhost/38727] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:09,817 INFO [Listener at localhost/38727] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/java.io.tmpdir/Jetty_localhost_44869_datanode____dyeaxu/webapp 2023-02-19 21:00:09,956 INFO [Listener at localhost/38727] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44869 2023-02-19 21:00:09,965 WARN [Listener at localhost/36139] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:11,226 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 21:00:11,449 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 21:00:11,621 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8050c0ac85456b3b: Processing first storage report for DS-8d228bcd-098d-48ed-a0c4-6f11fc50813f from datanode fb8cb3b7-8574-479b-8d0c-2b896d705601 2023-02-19 21:00:11,621 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8050c0ac85456b3b: from storage DS-8d228bcd-098d-48ed-a0c4-6f11fc50813f node DatanodeRegistration(127.0.0.1:34547, datanodeUuid=fb8cb3b7-8574-479b-8d0c-2b896d705601, infoPort=41371, infoSecurePort=0, ipcPort=38727, storageInfo=lv=-57;cid=testClusterID;nsid=791623936;c=1676840407849), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:11,621 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8050c0ac85456b3b: Processing first storage report for DS-7ef711af-1fac-4d10-af49-35cd4677b660 from datanode fb8cb3b7-8574-479b-8d0c-2b896d705601 2023-02-19 21:00:11,621 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8050c0ac85456b3b: from storage DS-7ef711af-1fac-4d10-af49-35cd4677b660 node DatanodeRegistration(127.0.0.1:34547, datanodeUuid=fb8cb3b7-8574-479b-8d0c-2b896d705601, infoPort=41371, infoSecurePort=0, ipcPort=38727, storageInfo=lv=-57;cid=testClusterID;nsid=791623936;c=1676840407849), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:11,630 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf5697d54e9d0981a: Processing first storage report for DS-8a18ab2b-a077-4d1b-9038-38f07c4b0c65 from datanode 487f8917-6d94-4abb-af18-b9388c64c547 2023-02-19 21:00:11,630 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf5697d54e9d0981a: from storage DS-8a18ab2b-a077-4d1b-9038-38f07c4b0c65 node DatanodeRegistration(127.0.0.1:44009, datanodeUuid=487f8917-6d94-4abb-af18-b9388c64c547, infoPort=35293, infoSecurePort=0, ipcPort=36139, storageInfo=lv=-57;cid=testClusterID;nsid=791623936;c=1676840407849), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:11,630 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf5697d54e9d0981a: Processing first storage report for DS-ea28d101-2be5-4405-9ac5-d1eac9bfced2 from datanode 487f8917-6d94-4abb-af18-b9388c64c547 2023-02-19 21:00:11,630 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf5697d54e9d0981a: from storage DS-ea28d101-2be5-4405-9ac5-d1eac9bfced2 node DatanodeRegistration(127.0.0.1:44009, datanodeUuid=487f8917-6d94-4abb-af18-b9388c64c547, infoPort=35293, infoSecurePort=0, ipcPort=36139, storageInfo=lv=-57;cid=testClusterID;nsid=791623936;c=1676840407849), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:11,689 DEBUG [Listener at localhost/36139] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3 2023-02-19 21:00:11,692 INFO [Listener at localhost/36139] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/cluster_158ecc85-7faa-e6d3-042e-f6f1c86f3a3d/zookeeper_0, clientPort=61730, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/cluster_158ecc85-7faa-e6d3-042e-f6f1c86f3a3d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/cluster_158ecc85-7faa-e6d3-042e-f6f1c86f3a3d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 21:00:11,695 INFO [Listener at localhost/36139] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61730 2023-02-19 21:00:11,695 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:11,696 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:11,724 INFO [Listener at localhost/36139] util.FSUtils(479): Created version file at hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa with version=8 2023-02-19 21:00:11,724 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:11,725 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:11,727 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/hbase-staging 2023-02-19 21:00:11,729 INFO [Listener at localhost/36139] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:11,729 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:11,729 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:11,729 INFO [Listener at localhost/36139] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:11,729 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:11,729 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:11,729 INFO [Listener at localhost/36139] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:11,730 INFO [Listener at localhost/36139] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35303 2023-02-19 21:00:11,731 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:11,732 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:11,733 INFO [Listener at localhost/36139] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35303 connecting to ZooKeeper ensemble=127.0.0.1:61730 2023-02-19 21:00:11,744 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:353030x0, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:11,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35303-0x1006e620bf10000 connected 2023-02-19 21:00:11,760 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:11,760 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:11,761 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:11,762 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35303 2023-02-19 21:00:11,764 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35303 2023-02-19 21:00:11,768 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35303 2023-02-19 21:00:11,768 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35303 2023-02-19 21:00:11,770 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35303 2023-02-19 21:00:11,770 INFO [Listener at localhost/36139] master.HMaster(444): hbase.rootdir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa, hbase.cluster.distributed=false 2023-02-19 21:00:11,785 INFO [Listener at localhost/36139] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:11,785 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:11,785 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:11,785 INFO [Listener at localhost/36139] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:11,786 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:11,786 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:11,786 INFO [Listener at localhost/36139] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:11,793 INFO [Listener at localhost/36139] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44177 2023-02-19 21:00:11,794 INFO [Listener at localhost/36139] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 21:00:11,796 DEBUG [Listener at localhost/36139] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:11,796 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:11,798 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:11,799 INFO [Listener at localhost/36139] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44177 connecting to ZooKeeper ensemble=127.0.0.1:61730 2023-02-19 21:00:11,804 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:441770x0, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:11,805 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44177-0x1006e620bf10001 connected 2023-02-19 21:00:11,805 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:11,810 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:11,811 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:11,812 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44177 2023-02-19 21:00:11,812 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44177 2023-02-19 21:00:11,816 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44177 2023-02-19 21:00:11,819 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44177 2023-02-19 21:00:11,820 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44177 2023-02-19 21:00:11,835 INFO [Listener at localhost/36139] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:11,835 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:11,835 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:11,835 INFO [Listener at localhost/36139] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:11,835 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:11,836 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:11,836 INFO [Listener at localhost/36139] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:11,837 INFO [Listener at localhost/36139] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35055 2023-02-19 21:00:11,838 INFO [Listener at localhost/36139] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 21:00:11,840 DEBUG [Listener at localhost/36139] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:11,841 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:11,842 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:11,843 INFO [Listener at localhost/36139] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35055 connecting to ZooKeeper ensemble=127.0.0.1:61730 2023-02-19 21:00:11,846 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:350550x0, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:11,847 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): regionserver:350550x0, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:11,847 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): regionserver:350550x0, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:11,848 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): regionserver:350550x0, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:11,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35055-0x1006e620bf10002 connected 2023-02-19 21:00:11,858 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35055 2023-02-19 21:00:11,858 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35055 2023-02-19 21:00:11,860 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35055 2023-02-19 21:00:11,864 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35055 2023-02-19 21:00:11,864 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35055 2023-02-19 21:00:11,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35303,1676840411728 2023-02-19 21:00:11,867 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 21:00:11,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35303,1676840411728 2023-02-19 21:00:11,869 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:11,869 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:11,870 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:11,870 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:11,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 21:00:11,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35303,1676840411728 from backup master directory 2023-02-19 21:00:11,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 21:00:11,875 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35303,1676840411728 2023-02-19 21:00:11,875 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:11,875 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 21:00:11,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35303,1676840411728 2023-02-19 21:00:11,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/hbase.id with ID: d8cb6ea9-1047-4c7c-a827-ad0a22ef52a4 2023-02-19 21:00:11,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:11,915 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:11,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7bfeada8 to 127.0.0.1:61730 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:11,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@97444a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:11,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:11,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 21:00:11,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:11,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/data/master/store-tmp 2023-02-19 21:00:11,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:11,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:11,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:11,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:11,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:11,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:11,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:11,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:11,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/WALs/jenkins-hbase4.apache.org,35303,1676840411728 2023-02-19 21:00:11,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35303%2C1676840411728, suffix=, logDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/WALs/jenkins-hbase4.apache.org,35303,1676840411728, archiveDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/oldWALs, maxLogs=10 2023-02-19 21:00:11,974 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44009,DS-8a18ab2b-a077-4d1b-9038-38f07c4b0c65,DISK] 2023-02-19 21:00:11,974 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34547,DS-8d228bcd-098d-48ed-a0c4-6f11fc50813f,DISK] 2023-02-19 21:00:11,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/WALs/jenkins-hbase4.apache.org,35303,1676840411728/jenkins-hbase4.apache.org%2C35303%2C1676840411728.1676840411952 2023-02-19 21:00:11,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44009,DS-8a18ab2b-a077-4d1b-9038-38f07c4b0c65,DISK], DatanodeInfoWithStorage[127.0.0.1:34547,DS-8d228bcd-098d-48ed-a0c4-6f11fc50813f,DISK]] 2023-02-19 21:00:11,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:11,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:11,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:11,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:11,982 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:11,984 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 21:00:11,984 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 21:00:11,985 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:11,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:11,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:11,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:11,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:11,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70139784, jitterRate=0.04516422748565674}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 21:00:11,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:11,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 21:00:11,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 21:00:11,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 21:00:11,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 21:00:11,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 21:00:11,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 21:00:11,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 21:00:11,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 21:00:11,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 21:00:12,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 21:00:12,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 21:00:12,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 21:00:12,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 21:00:12,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 21:00:12,011 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:12,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 21:00:12,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 21:00:12,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 21:00:12,020 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:12,020 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:12,020 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:12,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:12,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35303,1676840411728, sessionid=0x1006e620bf10000, setting cluster-up flag (Was=false) 2023-02-19 21:00:12,026 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:12,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 21:00:12,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35303,1676840411728 2023-02-19 21:00:12,036 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:12,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 21:00:12,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35303,1676840411728 2023-02-19 21:00:12,043 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.hbase-snapshot/.tmp 2023-02-19 21:00:12,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:12,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:12,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:12,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:12,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:12,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 21:00:12,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:12,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676840442049 2023-02-19 21:00:12,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 21:00:12,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 21:00:12,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 21:00:12,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 21:00:12,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 21:00:12,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 21:00:12,050 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:12,050 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 21:00:12,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 21:00:12,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 21:00:12,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 21:00:12,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 21:00:12,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 21:00:12,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840412051,5,FailOnTimeoutGroup] 2023-02-19 21:00:12,051 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:12,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840412051,5,FailOnTimeoutGroup] 2023-02-19 21:00:12,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 21:00:12,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,064 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:12,064 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:12,065 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa 2023-02-19 21:00:12,067 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(952): ClusterId : d8cb6ea9-1047-4c7c-a827-ad0a22ef52a4 2023-02-19 21:00:12,067 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(952): ClusterId : d8cb6ea9-1047-4c7c-a827-ad0a22ef52a4 2023-02-19 21:00:12,067 DEBUG [RS:1;jenkins-hbase4:35055] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 21:00:12,067 DEBUG [RS:0;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 21:00:12,069 DEBUG [RS:0;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 21:00:12,069 DEBUG [RS:0;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 21:00:12,069 DEBUG [RS:1;jenkins-hbase4:35055] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 21:00:12,070 DEBUG [RS:1;jenkins-hbase4:35055] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 21:00:12,072 DEBUG [RS:1;jenkins-hbase4:35055] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 21:00:12,072 DEBUG [RS:0;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 21:00:12,077 DEBUG [RS:0;jenkins-hbase4:44177] zookeeper.ReadOnlyZKClient(139): Connect 0x3a9711c2 to 127.0.0.1:61730 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:12,077 DEBUG [RS:1;jenkins-hbase4:35055] zookeeper.ReadOnlyZKClient(139): Connect 0x62b4e752 to 127.0.0.1:61730 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:12,083 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:12,084 DEBUG [RS:0;jenkins-hbase4:44177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3450f8e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:12,084 DEBUG [RS:0;jenkins-hbase4:44177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@306f7ab2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:12,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 21:00:12,088 DEBUG [RS:1;jenkins-hbase4:35055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c731574, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:12,088 DEBUG [RS:1;jenkins-hbase4:35055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@684c8c22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:12,092 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/info 2023-02-19 21:00:12,092 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 21:00:12,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:12,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 21:00:12,094 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:12,095 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 21:00:12,095 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:12,095 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 21:00:12,096 DEBUG [RS:1;jenkins-hbase4:35055] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35055 2023-02-19 21:00:12,096 INFO [RS:1;jenkins-hbase4:35055] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 21:00:12,096 INFO [RS:1;jenkins-hbase4:35055] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 21:00:12,096 DEBUG [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 21:00:12,097 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/table 2023-02-19 21:00:12,097 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 21:00:12,097 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35303,1676840411728 with isa=jenkins-hbase4.apache.org/172.31.14.131:35055, startcode=1676840411835 2023-02-19 21:00:12,097 DEBUG [RS:0;jenkins-hbase4:44177] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44177 2023-02-19 21:00:12,097 INFO [RS:0;jenkins-hbase4:44177] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 21:00:12,097 DEBUG [RS:1;jenkins-hbase4:35055] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 21:00:12,097 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:12,097 INFO [RS:0;jenkins-hbase4:44177] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 21:00:12,098 DEBUG [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 21:00:12,098 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35303,1676840411728 with isa=jenkins-hbase4.apache.org/172.31.14.131:44177, startcode=1676840411784 2023-02-19 21:00:12,098 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740 2023-02-19 21:00:12,098 DEBUG [RS:0;jenkins-hbase4:44177] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 21:00:12,099 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740 2023-02-19 21:00:12,101 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48113, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 21:00:12,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:12,103 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37811, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 21:00:12,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:12,104 DEBUG [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa 2023-02-19 21:00:12,104 DEBUG [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43691 2023-02-19 21:00:12,104 DEBUG [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 21:00:12,104 DEBUG [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa 2023-02-19 21:00:12,104 DEBUG [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43691 2023-02-19 21:00:12,104 DEBUG [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 21:00:12,105 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 21:00:12,106 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:12,107 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 21:00:12,110 DEBUG [RS:1;jenkins-hbase4:35055] zookeeper.ZKUtil(162): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:12,110 WARN [RS:1;jenkins-hbase4:35055] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:12,110 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44177,1676840411784] 2023-02-19 21:00:12,110 INFO [RS:1;jenkins-hbase4:35055] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:12,111 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:12,111 DEBUG [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/WALs/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:12,111 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35055,1676840411835] 2023-02-19 21:00:12,111 DEBUG [RS:0;jenkins-hbase4:44177] zookeeper.ZKUtil(162): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:12,111 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72419406, jitterRate=0.07913324236869812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 21:00:12,111 WARN [RS:0;jenkins-hbase4:44177] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:12,111 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 21:00:12,111 INFO [RS:0;jenkins-hbase4:44177] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:12,112 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:12,112 DEBUG [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/WALs/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:12,112 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:12,112 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:12,112 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:12,112 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:12,118 DEBUG [RS:1;jenkins-hbase4:35055] zookeeper.ZKUtil(162): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:12,118 DEBUG [RS:1;jenkins-hbase4:35055] zookeeper.ZKUtil(162): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:12,119 DEBUG [RS:1;jenkins-hbase4:35055] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 21:00:12,119 INFO [RS:1;jenkins-hbase4:35055] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 21:00:12,123 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:12,123 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:12,125 INFO [RS:1;jenkins-hbase4:35055] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 21:00:12,132 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:12,132 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 21:00:12,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 21:00:12,133 INFO [RS:1;jenkins-hbase4:35055] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 21:00:12,133 INFO [RS:1;jenkins-hbase4:35055] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,133 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 21:00:12,134 DEBUG [RS:0;jenkins-hbase4:44177] zookeeper.ZKUtil(162): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:12,135 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 21:00:12,135 INFO [RS:1;jenkins-hbase4:35055] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,135 DEBUG [RS:1;jenkins-hbase4:35055] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,136 DEBUG [RS:1;jenkins-hbase4:35055] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,136 DEBUG [RS:0;jenkins-hbase4:44177] zookeeper.ZKUtil(162): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:12,136 DEBUG [RS:1;jenkins-hbase4:35055] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,136 DEBUG [RS:1;jenkins-hbase4:35055] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,137 DEBUG [RS:1;jenkins-hbase4:35055] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,137 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 21:00:12,137 DEBUG [RS:1;jenkins-hbase4:35055] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:12,137 DEBUG [RS:1;jenkins-hbase4:35055] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,137 DEBUG [RS:1;jenkins-hbase4:35055] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,137 DEBUG [RS:1;jenkins-hbase4:35055] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,137 DEBUG [RS:1;jenkins-hbase4:35055] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,137 DEBUG [RS:0;jenkins-hbase4:44177] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 21:00:12,138 INFO [RS:0;jenkins-hbase4:44177] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 21:00:12,140 INFO [RS:0;jenkins-hbase4:44177] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 21:00:12,141 INFO [RS:1;jenkins-hbase4:35055] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,141 INFO [RS:1;jenkins-hbase4:35055] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,141 INFO [RS:1;jenkins-hbase4:35055] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,143 INFO [RS:0;jenkins-hbase4:44177] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 21:00:12,143 INFO [RS:0;jenkins-hbase4:44177] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,143 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 21:00:12,145 INFO [RS:0;jenkins-hbase4:44177] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,145 DEBUG [RS:0;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,145 DEBUG [RS:0;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,145 DEBUG [RS:0;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,145 DEBUG [RS:0;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,145 DEBUG [RS:0;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,145 DEBUG [RS:0;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:12,145 DEBUG [RS:0;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,145 DEBUG [RS:0;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,146 DEBUG [RS:0;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,146 DEBUG [RS:0;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:12,156 INFO [RS:0;jenkins-hbase4:44177] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,156 INFO [RS:0;jenkins-hbase4:44177] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,156 INFO [RS:0;jenkins-hbase4:44177] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,166 INFO [RS:0;jenkins-hbase4:44177] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 21:00:12,167 INFO [RS:0;jenkins-hbase4:44177] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44177,1676840411784-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,167 INFO [RS:1;jenkins-hbase4:35055] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 21:00:12,167 INFO [RS:1;jenkins-hbase4:35055] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35055,1676840411835-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,178 INFO [RS:0;jenkins-hbase4:44177] regionserver.Replication(203): jenkins-hbase4.apache.org,44177,1676840411784 started 2023-02-19 21:00:12,178 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44177,1676840411784, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44177, sessionid=0x1006e620bf10001 2023-02-19 21:00:12,178 DEBUG [RS:0;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 21:00:12,178 DEBUG [RS:0;jenkins-hbase4:44177] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:12,178 DEBUG [RS:0;jenkins-hbase4:44177] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44177,1676840411784' 2023-02-19 21:00:12,178 INFO [RS:1;jenkins-hbase4:35055] regionserver.Replication(203): jenkins-hbase4.apache.org,35055,1676840411835 started 2023-02-19 21:00:12,178 DEBUG [RS:0;jenkins-hbase4:44177] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:12,179 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35055,1676840411835, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35055, sessionid=0x1006e620bf10002 2023-02-19 21:00:12,179 DEBUG [RS:1;jenkins-hbase4:35055] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 21:00:12,179 DEBUG [RS:1;jenkins-hbase4:35055] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:12,179 DEBUG [RS:1;jenkins-hbase4:35055] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35055,1676840411835' 2023-02-19 21:00:12,179 DEBUG [RS:1;jenkins-hbase4:35055] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:12,179 DEBUG [RS:0;jenkins-hbase4:44177] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:12,179 DEBUG [RS:1;jenkins-hbase4:35055] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:12,180 DEBUG [RS:0;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 21:00:12,180 DEBUG [RS:0;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 21:00:12,180 DEBUG [RS:0;jenkins-hbase4:44177] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:12,180 DEBUG [RS:0;jenkins-hbase4:44177] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44177,1676840411784' 2023-02-19 21:00:12,180 DEBUG [RS:0;jenkins-hbase4:44177] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:12,180 DEBUG [RS:1;jenkins-hbase4:35055] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 21:00:12,180 DEBUG [RS:1;jenkins-hbase4:35055] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 21:00:12,180 DEBUG [RS:1;jenkins-hbase4:35055] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:12,180 DEBUG [RS:1;jenkins-hbase4:35055] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35055,1676840411835' 2023-02-19 21:00:12,180 DEBUG [RS:1;jenkins-hbase4:35055] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:12,180 DEBUG [RS:0;jenkins-hbase4:44177] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:12,181 DEBUG [RS:1;jenkins-hbase4:35055] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:12,181 DEBUG [RS:1;jenkins-hbase4:35055] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 21:00:12,181 DEBUG [RS:0;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 21:00:12,181 INFO [RS:1;jenkins-hbase4:35055] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 21:00:12,181 INFO [RS:0;jenkins-hbase4:44177] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 21:00:12,181 INFO [RS:0;jenkins-hbase4:44177] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 21:00:12,181 INFO [RS:1;jenkins-hbase4:35055] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 21:00:12,287 DEBUG [jenkins-hbase4:35303] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 21:00:12,287 DEBUG [jenkins-hbase4:35303] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:12,289 DEBUG [jenkins-hbase4:35303] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:12,289 DEBUG [jenkins-hbase4:35303] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:12,289 DEBUG [jenkins-hbase4:35303] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:12,290 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44177,1676840411784, state=OPENING 2023-02-19 21:00:12,292 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 21:00:12,293 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:12,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44177,1676840411784}] 2023-02-19 21:00:12,294 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 21:00:12,449 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:12,449 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 21:00:12,454 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36044, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 21:00:12,475 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 21:00:12,475 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:12,484 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44177%2C1676840411784.meta, suffix=.meta, logDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/WALs/jenkins-hbase4.apache.org,44177,1676840411784, archiveDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/oldWALs, maxLogs=32 2023-02-19 21:00:12,506 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44009,DS-8a18ab2b-a077-4d1b-9038-38f07c4b0c65,DISK] 2023-02-19 21:00:12,508 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34547,DS-8d228bcd-098d-48ed-a0c4-6f11fc50813f,DISK] 2023-02-19 21:00:12,513 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/WALs/jenkins-hbase4.apache.org,44177,1676840411784/jenkins-hbase4.apache.org%2C44177%2C1676840411784.meta.1676840412485.meta 2023-02-19 21:00:12,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44009,DS-8a18ab2b-a077-4d1b-9038-38f07c4b0c65,DISK], DatanodeInfoWithStorage[127.0.0.1:34547,DS-8d228bcd-098d-48ed-a0c4-6f11fc50813f,DISK]] 2023-02-19 21:00:12,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:12,514 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 21:00:12,514 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 21:00:12,515 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 21:00:12,515 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 21:00:12,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:12,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 21:00:12,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 21:00:12,517 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 21:00:12,519 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/info 2023-02-19 21:00:12,519 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/info 2023-02-19 21:00:12,519 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 21:00:12,520 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:12,520 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 21:00:12,521 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:12,521 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:12,522 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 21:00:12,522 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:12,522 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 21:00:12,523 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/table 2023-02-19 21:00:12,523 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/table 2023-02-19 21:00:12,524 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 21:00:12,524 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:12,525 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740 2023-02-19 21:00:12,527 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740 2023-02-19 21:00:12,529 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 21:00:12,530 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 21:00:12,531 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62323809, jitterRate=-0.0713028758764267}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 21:00:12,531 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 21:00:12,532 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676840412449 2023-02-19 21:00:12,537 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 21:00:12,538 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 21:00:12,538 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44177,1676840411784, state=OPEN 2023-02-19 21:00:12,540 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 21:00:12,540 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 21:00:12,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 21:00:12,544 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44177,1676840411784 in 247 msec 2023-02-19 21:00:12,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 21:00:12,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 411 msec 2023-02-19 21:00:12,548 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 503 msec 2023-02-19 21:00:12,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676840412548, completionTime=-1 2023-02-19 21:00:12,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 21:00:12,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 21:00:12,554 DEBUG [hconnection-0x42f1e9d5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:12,562 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36054, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:12,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 21:00:12,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676840472565 2023-02-19 21:00:12,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676840532565 2023-02-19 21:00:12,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 16 msec 2023-02-19 21:00:12,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35303,1676840411728-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35303,1676840411728-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35303,1676840411728-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35303, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:12,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 21:00:12,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:12,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 21:00:12,578 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 21:00:12,578 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 21:00:12,579 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 21:00:12,585 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5 2023-02-19 21:00:12,586 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5 empty. 2023-02-19 21:00:12,586 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5 2023-02-19 21:00:12,586 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 21:00:12,603 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:12,611 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8940e87a9ffbc633376da75959cc7ec5, NAME => 'hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp 2023-02-19 21:00:12,634 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:12,635 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 8940e87a9ffbc633376da75959cc7ec5, disabling compactions & flushes 2023-02-19 21:00:12,635 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. 2023-02-19 21:00:12,635 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. 2023-02-19 21:00:12,635 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. after waiting 0 ms 2023-02-19 21:00:12,635 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. 2023-02-19 21:00:12,635 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. 2023-02-19 21:00:12,635 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 8940e87a9ffbc633376da75959cc7ec5: 2023-02-19 21:00:12,648 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 21:00:12,649 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840412649"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840412649"}]},"ts":"1676840412649"} 2023-02-19 21:00:12,652 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 21:00:12,653 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 21:00:12,654 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840412653"}]},"ts":"1676840412653"} 2023-02-19 21:00:12,655 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 21:00:12,659 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:12,659 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:12,659 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:12,659 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:12,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8940e87a9ffbc633376da75959cc7ec5, ASSIGN}] 2023-02-19 21:00:12,662 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8940e87a9ffbc633376da75959cc7ec5, ASSIGN 2023-02-19 21:00:12,663 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8940e87a9ffbc633376da75959cc7ec5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35055,1676840411835; forceNewPlan=false, retain=false 2023-02-19 21:00:12,813 INFO [jenkins-hbase4:35303] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 21:00:12,814 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8940e87a9ffbc633376da75959cc7ec5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:12,814 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840412814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840412814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840412814"}]},"ts":"1676840412814"} 2023-02-19 21:00:12,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8940e87a9ffbc633376da75959cc7ec5, server=jenkins-hbase4.apache.org,35055,1676840411835}] 2023-02-19 21:00:12,974 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:12,974 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 21:00:12,977 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59394, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 21:00:12,981 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. 2023-02-19 21:00:12,982 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35055%2C1676840411835, suffix=, logDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/WALs/jenkins-hbase4.apache.org,35055,1676840411835, archiveDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/oldWALs, maxLogs=32 2023-02-19 21:00:13,002 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34547,DS-8d228bcd-098d-48ed-a0c4-6f11fc50813f,DISK] 2023-02-19 21:00:13,002 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44009,DS-8a18ab2b-a077-4d1b-9038-38f07c4b0c65,DISK] 2023-02-19 21:00:13,011 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/WALs/jenkins-hbase4.apache.org,35055,1676840411835/jenkins-hbase4.apache.org%2C35055%2C1676840411835.1676840412983 2023-02-19 21:00:13,012 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44009,DS-8a18ab2b-a077-4d1b-9038-38f07c4b0c65,DISK], DatanodeInfoWithStorage[127.0.0.1:34547,DS-8d228bcd-098d-48ed-a0c4-6f11fc50813f,DISK]] 2023-02-19 21:00:13,013 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8940e87a9ffbc633376da75959cc7ec5, NAME => 'hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:13,013 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8940e87a9ffbc633376da75959cc7ec5 2023-02-19 21:00:13,013 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,013 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8940e87a9ffbc633376da75959cc7ec5 2023-02-19 21:00:13,013 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8940e87a9ffbc633376da75959cc7ec5 2023-02-19 21:00:13,015 INFO [StoreOpener-8940e87a9ffbc633376da75959cc7ec5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8940e87a9ffbc633376da75959cc7ec5 2023-02-19 21:00:13,018 DEBUG [StoreOpener-8940e87a9ffbc633376da75959cc7ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5/info 2023-02-19 21:00:13,018 DEBUG [StoreOpener-8940e87a9ffbc633376da75959cc7ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5/info 2023-02-19 21:00:13,019 INFO [StoreOpener-8940e87a9ffbc633376da75959cc7ec5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8940e87a9ffbc633376da75959cc7ec5 columnFamilyName info 2023-02-19 21:00:13,020 INFO [StoreOpener-8940e87a9ffbc633376da75959cc7ec5-1] regionserver.HStore(310): Store=8940e87a9ffbc633376da75959cc7ec5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5 2023-02-19 21:00:13,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5 2023-02-19 21:00:13,026 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8940e87a9ffbc633376da75959cc7ec5 2023-02-19 21:00:13,029 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:13,029 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8940e87a9ffbc633376da75959cc7ec5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64445108, jitterRate=-0.03969305753707886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 21:00:13,029 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8940e87a9ffbc633376da75959cc7ec5: 2023-02-19 21:00:13,030 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5., pid=6, masterSystemTime=1676840412974 2023-02-19 21:00:13,036 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. 2023-02-19 21:00:13,036 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. 2023-02-19 21:00:13,037 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8940e87a9ffbc633376da75959cc7ec5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:13,037 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840413037"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840413037"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840413037"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840413037"}]},"ts":"1676840413037"} 2023-02-19 21:00:13,041 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 21:00:13,041 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8940e87a9ffbc633376da75959cc7ec5, server=jenkins-hbase4.apache.org,35055,1676840411835 in 223 msec 2023-02-19 21:00:13,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 21:00:13,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8940e87a9ffbc633376da75959cc7ec5, ASSIGN in 381 msec 2023-02-19 21:00:13,044 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 21:00:13,044 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840413044"}]},"ts":"1676840413044"} 2023-02-19 21:00:13,045 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 21:00:13,049 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 21:00:13,051 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 475 msec 2023-02-19 21:00:13,078 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 21:00:13,079 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:13,080 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:13,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:13,086 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59398, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:13,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 21:00:13,099 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:13,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-19 21:00:13,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 21:00:13,118 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:13,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-19 21:00:13,124 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 21:00:13,127 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 21:00:13,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.252sec 2023-02-19 21:00:13,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 21:00:13,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 21:00:13,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 21:00:13,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35303,1676840411728-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 21:00:13,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35303,1676840411728-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 21:00:13,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 21:00:13,167 DEBUG [Listener at localhost/36139] zookeeper.ReadOnlyZKClient(139): Connect 0x0086a8ce to 127.0.0.1:61730 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:13,171 DEBUG [Listener at localhost/36139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dae1ba8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:13,173 DEBUG [hconnection-0x6a4a45fe-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:13,176 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36062, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:13,177 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35303,1676840411728 2023-02-19 21:00:13,177 DEBUG [Listener at localhost/36139] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 21:00:13,179 DEBUG [Listener at localhost/36139] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 21:00:13,181 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39794, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 21:00:13,181 INFO [Listener at localhost/36139] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 21:00:13,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 21:00:13,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 21:00:13,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:39794 deadline: 1676840473182, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-19 21:00:13,183 INFO [Listener at localhost/36139] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-19 21:00:13,184 INFO [RS:0;jenkins-hbase4:44177] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44177%2C1676840411784, suffix=, logDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/WALs/jenkins-hbase4.apache.org,44177,1676840411784, archiveDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/oldWALs, maxLogs=32 2023-02-19 21:00:13,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:13,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-19 21:00:13,189 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 21:00:13,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-19 21:00:13,190 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 21:00:13,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:13,200 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34547,DS-8d228bcd-098d-48ed-a0c4-6f11fc50813f,DISK] 2023-02-19 21:00:13,203 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44009,DS-8a18ab2b-a077-4d1b-9038-38f07c4b0c65,DISK] 2023-02-19 21:00:13,204 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:13,204 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:13,204 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:13,204 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:13,204 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:13,204 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:13,204 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:13,205 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340 empty. 2023-02-19 21:00:13,205 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7 empty. 2023-02-19 21:00:13,204 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:13,205 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984 empty. 2023-02-19 21:00:13,205 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf empty. 2023-02-19 21:00:13,205 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:13,205 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237 empty. 2023-02-19 21:00:13,205 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:13,205 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7 empty. 2023-02-19 21:00:13,206 INFO [RS:0;jenkins-hbase4:44177] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/WALs/jenkins-hbase4.apache.org,44177,1676840411784/jenkins-hbase4.apache.org%2C44177%2C1676840411784.1676840413185 2023-02-19 21:00:13,206 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:13,206 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:13,206 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:13,206 DEBUG [RS:0;jenkins-hbase4:44177] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34547,DS-8d228bcd-098d-48ed-a0c4-6f11fc50813f,DISK], DatanodeInfoWithStorage[127.0.0.1:44009,DS-8a18ab2b-a077-4d1b-9038-38f07c4b0c65,DISK]] 2023-02-19 21:00:13,206 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488 empty. 2023-02-19 21:00:13,206 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63 empty. 2023-02-19 21:00:13,206 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442 empty. 2023-02-19 21:00:13,206 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:13,206 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:13,206 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:13,207 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:13,207 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:13,207 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:13,207 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e empty. 2023-02-19 21:00:13,207 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:13,207 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 21:00:13,224 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:13,225 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => f2be26e990ead654643aaf65441192a7, NAME => 'testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp 2023-02-19 21:00:13,226 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 649375b1437b5fbbb0130997c03b9237, NAME => 'testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp 2023-02-19 21:00:13,226 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1fb3b210b79863f4f4a657bdc1348340, NAME => 'testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp 2023-02-19 21:00:13,251 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,251 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing f2be26e990ead654643aaf65441192a7, disabling compactions & flushes 2023-02-19 21:00:13,251 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:13,251 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:13,251 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. after waiting 0 ms 2023-02-19 21:00:13,251 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:13,251 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:13,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for f2be26e990ead654643aaf65441192a7: 2023-02-19 21:00:13,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,252 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 132935b55b8490ef4f53379a26bb84bf, NAME => 'testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp 2023-02-19 21:00:13,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 1fb3b210b79863f4f4a657bdc1348340, disabling compactions & flushes 2023-02-19 21:00:13,252 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:13,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:13,253 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. after waiting 0 ms 2023-02-19 21:00:13,253 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:13,253 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:13,253 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 1fb3b210b79863f4f4a657bdc1348340: 2023-02-19 21:00:13,253 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1da2cc8fe80be9b38c7437909b2d1984, NAME => 'testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp 2023-02-19 21:00:13,253 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,254 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 649375b1437b5fbbb0130997c03b9237, disabling compactions & flushes 2023-02-19 21:00:13,254 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:13,254 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:13,254 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. after waiting 0 ms 2023-02-19 21:00:13,254 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:13,254 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:13,254 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 649375b1437b5fbbb0130997c03b9237: 2023-02-19 21:00:13,254 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 08c6b158dfb3a9845f2b1ed3bfbca488, NAME => 'testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp 2023-02-19 21:00:13,268 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,268 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 132935b55b8490ef4f53379a26bb84bf, disabling compactions & flushes 2023-02-19 21:00:13,268 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:13,268 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:13,269 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. after waiting 0 ms 2023-02-19 21:00:13,269 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:13,269 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:13,269 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 132935b55b8490ef4f53379a26bb84bf: 2023-02-19 21:00:13,269 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => fd61472f7d2cfb0dde552bda55e96c63, NAME => 'testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp 2023-02-19 21:00:13,272 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,273 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 1da2cc8fe80be9b38c7437909b2d1984, disabling compactions & flushes 2023-02-19 21:00:13,273 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:13,273 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:13,273 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. after waiting 0 ms 2023-02-19 21:00:13,273 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:13,273 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:13,273 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 1da2cc8fe80be9b38c7437909b2d1984: 2023-02-19 21:00:13,273 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c527b46dbc0a90273281c1e9126cddf7, NAME => 'testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp 2023-02-19 21:00:13,281 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,282 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 08c6b158dfb3a9845f2b1ed3bfbca488, disabling compactions & flushes 2023-02-19 21:00:13,282 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:13,282 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:13,282 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. after waiting 0 ms 2023-02-19 21:00:13,282 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:13,282 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:13,282 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 08c6b158dfb3a9845f2b1ed3bfbca488: 2023-02-19 21:00:13,282 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ef7d7d834df6c5d0bacd2e9dc81ee442, NAME => 'testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp 2023-02-19 21:00:13,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:13,294 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,294 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing fd61472f7d2cfb0dde552bda55e96c63, disabling compactions & flushes 2023-02-19 21:00:13,294 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:13,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:13,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. after waiting 0 ms 2023-02-19 21:00:13,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:13,295 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:13,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for fd61472f7d2cfb0dde552bda55e96c63: 2023-02-19 21:00:13,295 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8b67ff68656c504e3a3240f0c555682e, NAME => 'testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.tmp 2023-02-19 21:00:13,296 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,296 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c527b46dbc0a90273281c1e9126cddf7, disabling compactions & flushes 2023-02-19 21:00:13,296 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:13,296 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:13,296 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. after waiting 0 ms 2023-02-19 21:00:13,296 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:13,297 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:13,297 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c527b46dbc0a90273281c1e9126cddf7: 2023-02-19 21:00:13,298 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,298 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ef7d7d834df6c5d0bacd2e9dc81ee442, disabling compactions & flushes 2023-02-19 21:00:13,298 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:13,298 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:13,298 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. after waiting 0 ms 2023-02-19 21:00:13,298 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:13,298 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:13,298 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ef7d7d834df6c5d0bacd2e9dc81ee442: 2023-02-19 21:00:13,302 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,302 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 8b67ff68656c504e3a3240f0c555682e, disabling compactions & flushes 2023-02-19 21:00:13,303 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:13,303 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:13,303 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. after waiting 0 ms 2023-02-19 21:00:13,303 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:13,303 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:13,303 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 8b67ff68656c504e3a3240f0c555682e: 2023-02-19 21:00:13,305 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 21:00:13,307 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676840413185.f2be26e990ead654643aaf65441192a7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840413306"}]},"ts":"1676840413306"} 2023-02-19 21:00:13,307 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840413306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840413306"}]},"ts":"1676840413306"} 2023-02-19 21:00:13,307 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840413306"}]},"ts":"1676840413306"} 2023-02-19 21:00:13,307 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840413306"}]},"ts":"1676840413306"} 2023-02-19 21:00:13,307 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840413306"}]},"ts":"1676840413306"} 2023-02-19 21:00:13,307 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840413306"}]},"ts":"1676840413306"} 2023-02-19 21:00:13,307 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840413306"}]},"ts":"1676840413306"} 2023-02-19 21:00:13,308 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840413306"}]},"ts":"1676840413306"} 2023-02-19 21:00:13,308 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840413306"}]},"ts":"1676840413306"} 2023-02-19 21:00:13,308 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840413306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840413306"}]},"ts":"1676840413306"} 2023-02-19 21:00:13,311 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-19 21:00:13,316 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 21:00:13,316 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840413316"}]},"ts":"1676840413316"} 2023-02-19 21:00:13,319 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-19 21:00:13,323 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:13,331 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:13,331 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:13,331 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:13,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1fb3b210b79863f4f4a657bdc1348340, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=649375b1437b5fbbb0130997c03b9237, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f2be26e990ead654643aaf65441192a7, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=132935b55b8490ef4f53379a26bb84bf, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1da2cc8fe80be9b38c7437909b2d1984, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08c6b158dfb3a9845f2b1ed3bfbca488, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fd61472f7d2cfb0dde552bda55e96c63, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c527b46dbc0a90273281c1e9126cddf7, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ef7d7d834df6c5d0bacd2e9dc81ee442, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8b67ff68656c504e3a3240f0c555682e, ASSIGN}] 2023-02-19 21:00:13,334 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f2be26e990ead654643aaf65441192a7, ASSIGN 2023-02-19 21:00:13,334 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=132935b55b8490ef4f53379a26bb84bf, ASSIGN 2023-02-19 21:00:13,334 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=649375b1437b5fbbb0130997c03b9237, ASSIGN 2023-02-19 21:00:13,335 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1fb3b210b79863f4f4a657bdc1348340, ASSIGN 2023-02-19 21:00:13,340 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f2be26e990ead654643aaf65441192a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35055,1676840411835; forceNewPlan=false, retain=false 2023-02-19 21:00:13,340 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=649375b1437b5fbbb0130997c03b9237, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35055,1676840411835; forceNewPlan=false, retain=false 2023-02-19 21:00:13,340 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=132935b55b8490ef4f53379a26bb84bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44177,1676840411784; forceNewPlan=false, retain=false 2023-02-19 21:00:13,340 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1fb3b210b79863f4f4a657bdc1348340, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44177,1676840411784; forceNewPlan=false, retain=false 2023-02-19 21:00:13,340 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8b67ff68656c504e3a3240f0c555682e, ASSIGN 2023-02-19 21:00:13,341 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ef7d7d834df6c5d0bacd2e9dc81ee442, ASSIGN 2023-02-19 21:00:13,342 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c527b46dbc0a90273281c1e9126cddf7, ASSIGN 2023-02-19 21:00:13,342 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fd61472f7d2cfb0dde552bda55e96c63, ASSIGN 2023-02-19 21:00:13,343 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ef7d7d834df6c5d0bacd2e9dc81ee442, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35055,1676840411835; forceNewPlan=false, retain=false 2023-02-19 21:00:13,343 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8b67ff68656c504e3a3240f0c555682e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44177,1676840411784; forceNewPlan=false, retain=false 2023-02-19 21:00:13,343 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08c6b158dfb3a9845f2b1ed3bfbca488, ASSIGN 2023-02-19 21:00:13,344 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c527b46dbc0a90273281c1e9126cddf7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44177,1676840411784; forceNewPlan=false, retain=false 2023-02-19 21:00:13,344 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fd61472f7d2cfb0dde552bda55e96c63, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35055,1676840411835; forceNewPlan=false, retain=false 2023-02-19 21:00:13,344 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1da2cc8fe80be9b38c7437909b2d1984, ASSIGN 2023-02-19 21:00:13,345 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=08c6b158dfb3a9845f2b1ed3bfbca488, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44177,1676840411784; forceNewPlan=false, retain=false 2023-02-19 21:00:13,345 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1da2cc8fe80be9b38c7437909b2d1984, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35055,1676840411835; forceNewPlan=false, retain=false 2023-02-19 21:00:13,490 INFO [jenkins-hbase4:35303] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-19 21:00:13,495 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=c527b46dbc0a90273281c1e9126cddf7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:13,495 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8b67ff68656c504e3a3240f0c555682e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:13,495 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1fb3b210b79863f4f4a657bdc1348340, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:13,495 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=08c6b158dfb3a9845f2b1ed3bfbca488, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:13,495 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840413495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840413495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840413495"}]},"ts":"1676840413495"} 2023-02-19 21:00:13,495 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840413495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840413495"}]},"ts":"1676840413495"} 2023-02-19 21:00:13,495 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=132935b55b8490ef4f53379a26bb84bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:13,495 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840413495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840413495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840413495"}]},"ts":"1676840413495"} 2023-02-19 21:00:13,496 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840413495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840413495"}]},"ts":"1676840413495"} 2023-02-19 21:00:13,495 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840413495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840413495"}]},"ts":"1676840413495"} 2023-02-19 21:00:13,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:13,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=11, state=RUNNABLE; OpenRegionProcedure 1fb3b210b79863f4f4a657bdc1348340, server=jenkins-hbase4.apache.org,44177,1676840411784}] 2023-02-19 21:00:13,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 08c6b158dfb3a9845f2b1ed3bfbca488, server=jenkins-hbase4.apache.org,44177,1676840411784}] 2023-02-19 21:00:13,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=14, state=RUNNABLE; OpenRegionProcedure 132935b55b8490ef4f53379a26bb84bf, server=jenkins-hbase4.apache.org,44177,1676840411784}] 2023-02-19 21:00:13,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure c527b46dbc0a90273281c1e9126cddf7, server=jenkins-hbase4.apache.org,44177,1676840411784}] 2023-02-19 21:00:13,502 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure 8b67ff68656c504e3a3240f0c555682e, server=jenkins-hbase4.apache.org,44177,1676840411784}] 2023-02-19 21:00:13,504 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1da2cc8fe80be9b38c7437909b2d1984, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:13,505 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413504"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840413504"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840413504"}]},"ts":"1676840413504"} 2023-02-19 21:00:13,507 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ef7d7d834df6c5d0bacd2e9dc81ee442, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:13,507 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=fd61472f7d2cfb0dde552bda55e96c63, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:13,507 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413507"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840413507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840413507"}]},"ts":"1676840413507"} 2023-02-19 21:00:13,507 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413507"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840413507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840413507"}]},"ts":"1676840413507"} 2023-02-19 21:00:13,507 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=649375b1437b5fbbb0130997c03b9237, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:13,507 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413507"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840413507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840413507"}]},"ts":"1676840413507"} 2023-02-19 21:00:13,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure 1da2cc8fe80be9b38c7437909b2d1984, server=jenkins-hbase4.apache.org,35055,1676840411835}] 2023-02-19 21:00:13,510 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f2be26e990ead654643aaf65441192a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:13,510 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676840413185.f2be26e990ead654643aaf65441192a7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413510"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840413510"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840413510"}]},"ts":"1676840413510"} 2023-02-19 21:00:13,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure ef7d7d834df6c5d0bacd2e9dc81ee442, server=jenkins-hbase4.apache.org,35055,1676840411835}] 2023-02-19 21:00:13,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure fd61472f7d2cfb0dde552bda55e96c63, server=jenkins-hbase4.apache.org,35055,1676840411835}] 2023-02-19 21:00:13,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure 649375b1437b5fbbb0130997c03b9237, server=jenkins-hbase4.apache.org,35055,1676840411835}] 2023-02-19 21:00:13,514 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure f2be26e990ead654643aaf65441192a7, server=jenkins-hbase4.apache.org,35055,1676840411835}] 2023-02-19 21:00:13,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:13,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1fb3b210b79863f4f4a657bdc1348340, NAME => 'testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-19 21:00:13,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:13,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:13,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:13,656 INFO [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:13,657 DEBUG [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340/f1 2023-02-19 21:00:13,657 DEBUG [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340/f1 2023-02-19 21:00:13,657 INFO [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1fb3b210b79863f4f4a657bdc1348340 columnFamilyName f1 2023-02-19 21:00:13,658 INFO [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] regionserver.HStore(310): Store=1fb3b210b79863f4f4a657bdc1348340/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,658 INFO [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:13,659 DEBUG [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340/f2 2023-02-19 21:00:13,659 DEBUG [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340/f2 2023-02-19 21:00:13,660 INFO [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1fb3b210b79863f4f4a657bdc1348340 columnFamilyName f2 2023-02-19 21:00:13,660 INFO [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] regionserver.HStore(310): Store=1fb3b210b79863f4f4a657bdc1348340/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:13,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:13,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:13,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:13,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:13,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1fb3b210b79863f4f4a657bdc1348340; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59645876, jitterRate=-0.11120718717575073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:13,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1fb3b210b79863f4f4a657bdc1348340: 2023-02-19 21:00:13,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340., pid=21, masterSystemTime=1676840413650 2023-02-19 21:00:13,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:13,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1da2cc8fe80be9b38c7437909b2d1984, NAME => 'testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-19 21:00:13,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:13,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:13,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:13,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:13,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08c6b158dfb3a9845f2b1ed3bfbca488, NAME => 'testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-19 21:00:13,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,670 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1fb3b210b79863f4f4a657bdc1348340, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:13,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:13,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:13,670 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840413670"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840413670"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840413670"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840413670"}]},"ts":"1676840413670"} 2023-02-19 21:00:13,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:13,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:13,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:13,672 INFO [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:13,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=11 2023-02-19 21:00:13,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=11, state=SUCCESS; OpenRegionProcedure 1fb3b210b79863f4f4a657bdc1348340, server=jenkins-hbase4.apache.org,44177,1676840411784 in 174 msec 2023-02-19 21:00:13,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1fb3b210b79863f4f4a657bdc1348340, ASSIGN in 342 msec 2023-02-19 21:00:13,676 INFO [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:13,677 DEBUG [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f1 2023-02-19 21:00:13,677 DEBUG [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f1 2023-02-19 21:00:13,677 INFO [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1da2cc8fe80be9b38c7437909b2d1984 columnFamilyName f1 2023-02-19 21:00:13,677 DEBUG [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f1 2023-02-19 21:00:13,677 DEBUG [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f1 2023-02-19 21:00:13,678 INFO [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08c6b158dfb3a9845f2b1ed3bfbca488 columnFamilyName f1 2023-02-19 21:00:13,678 INFO [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] regionserver.HStore(310): Store=1da2cc8fe80be9b38c7437909b2d1984/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,678 INFO [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:13,678 INFO [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] regionserver.HStore(310): Store=08c6b158dfb3a9845f2b1ed3bfbca488/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,678 INFO [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:13,679 DEBUG [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f2 2023-02-19 21:00:13,679 DEBUG [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f2 2023-02-19 21:00:13,679 DEBUG [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f2 2023-02-19 21:00:13,679 INFO [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1da2cc8fe80be9b38c7437909b2d1984 columnFamilyName f2 2023-02-19 21:00:13,679 DEBUG [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f2 2023-02-19 21:00:13,680 INFO [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08c6b158dfb3a9845f2b1ed3bfbca488 columnFamilyName f2 2023-02-19 21:00:13,680 INFO [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] regionserver.HStore(310): Store=1da2cc8fe80be9b38c7437909b2d1984/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,680 INFO [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] regionserver.HStore(310): Store=08c6b158dfb3a9845f2b1ed3bfbca488/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:13,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:13,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:13,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:13,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:13,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:13,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:13,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:13,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:13,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1da2cc8fe80be9b38c7437909b2d1984; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72347661, jitterRate=0.07806415855884552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:13,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1da2cc8fe80be9b38c7437909b2d1984: 2023-02-19 21:00:13,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:13,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 08c6b158dfb3a9845f2b1ed3bfbca488; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59375054, jitterRate=-0.11524274945259094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:13,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 08c6b158dfb3a9845f2b1ed3bfbca488: 2023-02-19 21:00:13,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984., pid=26, masterSystemTime=1676840413666 2023-02-19 21:00:13,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488., pid=22, masterSystemTime=1676840413650 2023-02-19 21:00:13,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:13,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:13,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:13,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fd61472f7d2cfb0dde552bda55e96c63, NAME => 'testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-19 21:00:13,691 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1da2cc8fe80be9b38c7437909b2d1984, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:13,691 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413691"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840413691"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840413691"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840413691"}]},"ts":"1676840413691"} 2023-02-19 21:00:13,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:13,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:13,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:13,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:13,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:13,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:13,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 132935b55b8490ef4f53379a26bb84bf, NAME => 'testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-19 21:00:13,692 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=08c6b158dfb3a9845f2b1ed3bfbca488, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:13,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:13,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:13,692 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413692"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840413692"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840413692"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840413692"}]},"ts":"1676840413692"} 2023-02-19 21:00:13,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:13,693 INFO [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:13,695 DEBUG [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f1 2023-02-19 21:00:13,695 INFO [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:13,695 DEBUG [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f1 2023-02-19 21:00:13,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-19 21:00:13,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure 1da2cc8fe80be9b38c7437909b2d1984, server=jenkins-hbase4.apache.org,35055,1676840411835 in 187 msec 2023-02-19 21:00:13,696 INFO [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd61472f7d2cfb0dde552bda55e96c63 columnFamilyName f1 2023-02-19 21:00:13,697 INFO [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] regionserver.HStore(310): Store=fd61472f7d2cfb0dde552bda55e96c63/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,697 INFO [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:13,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1da2cc8fe80be9b38c7437909b2d1984, ASSIGN in 365 msec 2023-02-19 21:00:13,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-19 21:00:13,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 08c6b158dfb3a9845f2b1ed3bfbca488, server=jenkins-hbase4.apache.org,44177,1676840411784 in 196 msec 2023-02-19 21:00:13,697 DEBUG [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f1 2023-02-19 21:00:13,698 DEBUG [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f1 2023-02-19 21:00:13,698 INFO [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 132935b55b8490ef4f53379a26bb84bf columnFamilyName f1 2023-02-19 21:00:13,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=08c6b158dfb3a9845f2b1ed3bfbca488, ASSIGN in 366 msec 2023-02-19 21:00:13,698 DEBUG [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f2 2023-02-19 21:00:13,698 DEBUG [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f2 2023-02-19 21:00:13,699 INFO [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] regionserver.HStore(310): Store=132935b55b8490ef4f53379a26bb84bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,699 INFO [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd61472f7d2cfb0dde552bda55e96c63 columnFamilyName f2 2023-02-19 21:00:13,699 INFO [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:13,699 INFO [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] regionserver.HStore(310): Store=fd61472f7d2cfb0dde552bda55e96c63/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:13,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:13,701 DEBUG [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f2 2023-02-19 21:00:13,701 DEBUG [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f2 2023-02-19 21:00:13,701 INFO [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 132935b55b8490ef4f53379a26bb84bf columnFamilyName f2 2023-02-19 21:00:13,702 INFO [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] regionserver.HStore(310): Store=132935b55b8490ef4f53379a26bb84bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:13,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:13,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:13,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:13,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:13,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:13,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:13,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:13,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fd61472f7d2cfb0dde552bda55e96c63; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71118606, jitterRate=0.05974981188774109}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:13,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fd61472f7d2cfb0dde552bda55e96c63: 2023-02-19 21:00:13,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 132935b55b8490ef4f53379a26bb84bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64395706, jitterRate=-0.04042920470237732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:13,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 132935b55b8490ef4f53379a26bb84bf: 2023-02-19 21:00:13,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63., pid=28, masterSystemTime=1676840413666 2023-02-19 21:00:13,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf., pid=23, masterSystemTime=1676840413650 2023-02-19 21:00:13,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:13,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:13,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:13,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 649375b1437b5fbbb0130997c03b9237, NAME => 'testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-19 21:00:13,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:13,716 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=fd61472f7d2cfb0dde552bda55e96c63, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:13,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,716 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413716"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840413716"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840413716"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840413716"}]},"ts":"1676840413716"} 2023-02-19 21:00:13,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:13,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:13,716 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=132935b55b8490ef4f53379a26bb84bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:13,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:13,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:13,717 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413716"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840413716"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840413716"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840413716"}]},"ts":"1676840413716"} 2023-02-19 21:00:13,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:13,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8b67ff68656c504e3a3240f0c555682e, NAME => 'testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-19 21:00:13,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:13,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:13,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:13,718 INFO [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:13,719 INFO [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:13,720 DEBUG [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f1 2023-02-19 21:00:13,720 DEBUG [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f1 2023-02-19 21:00:13,721 INFO [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 649375b1437b5fbbb0130997c03b9237 columnFamilyName f1 2023-02-19 21:00:13,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=14 2023-02-19 21:00:13,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=14, state=SUCCESS; OpenRegionProcedure 132935b55b8490ef4f53379a26bb84bf, server=jenkins-hbase4.apache.org,44177,1676840411784 in 220 msec 2023-02-19 21:00:13,721 DEBUG [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e/f1 2023-02-19 21:00:13,721 DEBUG [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e/f1 2023-02-19 21:00:13,722 INFO [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] regionserver.HStore(310): Store=649375b1437b5fbbb0130997c03b9237/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,722 INFO [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b67ff68656c504e3a3240f0c555682e columnFamilyName f1 2023-02-19 21:00:13,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fd61472f7d2cfb0dde552bda55e96c63, ASSIGN in 389 msec 2023-02-19 21:00:13,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-19 21:00:13,722 INFO [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:13,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure fd61472f7d2cfb0dde552bda55e96c63, server=jenkins-hbase4.apache.org,35055,1676840411835 in 205 msec 2023-02-19 21:00:13,722 INFO [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] regionserver.HStore(310): Store=8b67ff68656c504e3a3240f0c555682e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,723 INFO [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:13,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=132935b55b8490ef4f53379a26bb84bf, ASSIGN in 390 msec 2023-02-19 21:00:13,724 DEBUG [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f2 2023-02-19 21:00:13,724 DEBUG [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e/f2 2023-02-19 21:00:13,724 DEBUG [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e/f2 2023-02-19 21:00:13,724 DEBUG [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f2 2023-02-19 21:00:13,724 INFO [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b67ff68656c504e3a3240f0c555682e columnFamilyName f2 2023-02-19 21:00:13,724 INFO [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 649375b1437b5fbbb0130997c03b9237 columnFamilyName f2 2023-02-19 21:00:13,725 INFO [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] regionserver.HStore(310): Store=8b67ff68656c504e3a3240f0c555682e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,725 INFO [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] regionserver.HStore(310): Store=649375b1437b5fbbb0130997c03b9237/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:13,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:13,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:13,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:13,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:13,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:13,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:13,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:13,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:13,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:13,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 649375b1437b5fbbb0130997c03b9237; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63317044, jitterRate=-0.05650252103805542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:13,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 649375b1437b5fbbb0130997c03b9237: 2023-02-19 21:00:13,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8b67ff68656c504e3a3240f0c555682e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61218326, jitterRate=-0.08777585625648499}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:13,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8b67ff68656c504e3a3240f0c555682e: 2023-02-19 21:00:13,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237., pid=29, masterSystemTime=1676840413666 2023-02-19 21:00:13,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e., pid=25, masterSystemTime=1676840413650 2023-02-19 21:00:13,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:13,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:13,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:13,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f2be26e990ead654643aaf65441192a7, NAME => 'testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-19 21:00:13,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:13,738 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=649375b1437b5fbbb0130997c03b9237, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:13,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:13,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:13,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:13,738 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413738"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840413738"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840413738"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840413738"}]},"ts":"1676840413738"} 2023-02-19 21:00:13,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:13,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:13,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c527b46dbc0a90273281c1e9126cddf7, NAME => 'testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-19 21:00:13,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:13,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:13,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:13,739 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8b67ff68656c504e3a3240f0c555682e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:13,740 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676840413739"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840413739"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840413739"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840413739"}]},"ts":"1676840413739"} 2023-02-19 21:00:13,741 INFO [StoreOpener-f2be26e990ead654643aaf65441192a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:13,741 INFO [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:13,743 DEBUG [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f1 2023-02-19 21:00:13,743 DEBUG [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f1 2023-02-19 21:00:13,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-19 21:00:13,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure 649375b1437b5fbbb0130997c03b9237, server=jenkins-hbase4.apache.org,35055,1676840411835 in 228 msec 2023-02-19 21:00:13,743 DEBUG [StoreOpener-f2be26e990ead654643aaf65441192a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f1 2023-02-19 21:00:13,744 DEBUG [StoreOpener-f2be26e990ead654643aaf65441192a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f1 2023-02-19 21:00:13,744 INFO [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c527b46dbc0a90273281c1e9126cddf7 columnFamilyName f1 2023-02-19 21:00:13,744 INFO [StoreOpener-f2be26e990ead654643aaf65441192a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2be26e990ead654643aaf65441192a7 columnFamilyName f1 2023-02-19 21:00:13,745 INFO [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] regionserver.HStore(310): Store=c527b46dbc0a90273281c1e9126cddf7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,745 INFO [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:13,745 INFO [StoreOpener-f2be26e990ead654643aaf65441192a7-1] regionserver.HStore(310): Store=f2be26e990ead654643aaf65441192a7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,745 INFO [StoreOpener-f2be26e990ead654643aaf65441192a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:13,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-19 21:00:13,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure 8b67ff68656c504e3a3240f0c555682e, server=jenkins-hbase4.apache.org,44177,1676840411784 in 241 msec 2023-02-19 21:00:13,746 DEBUG [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f2 2023-02-19 21:00:13,747 DEBUG [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f2 2023-02-19 21:00:13,747 INFO [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c527b46dbc0a90273281c1e9126cddf7 columnFamilyName f2 2023-02-19 21:00:13,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=649375b1437b5fbbb0130997c03b9237, ASSIGN in 413 msec 2023-02-19 21:00:13,748 INFO [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] regionserver.HStore(310): Store=c527b46dbc0a90273281c1e9126cddf7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8b67ff68656c504e3a3240f0c555682e, ASSIGN in 415 msec 2023-02-19 21:00:13,748 DEBUG [StoreOpener-f2be26e990ead654643aaf65441192a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f2 2023-02-19 21:00:13,748 DEBUG [StoreOpener-f2be26e990ead654643aaf65441192a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f2 2023-02-19 21:00:13,749 INFO [StoreOpener-f2be26e990ead654643aaf65441192a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2be26e990ead654643aaf65441192a7 columnFamilyName f2 2023-02-19 21:00:13,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:13,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:13,750 INFO [StoreOpener-f2be26e990ead654643aaf65441192a7-1] regionserver.HStore(310): Store=f2be26e990ead654643aaf65441192a7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:13,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:13,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:13,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:13,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:13,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:13,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:13,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:13,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c527b46dbc0a90273281c1e9126cddf7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60228493, jitterRate=-0.10252551734447479}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:13,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f2be26e990ead654643aaf65441192a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71225665, jitterRate=0.061345115303993225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:13,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c527b46dbc0a90273281c1e9126cddf7: 2023-02-19 21:00:13,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f2be26e990ead654643aaf65441192a7: 2023-02-19 21:00:13,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7., pid=24, masterSystemTime=1676840413650 2023-02-19 21:00:13,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7., pid=30, masterSystemTime=1676840413666 2023-02-19 21:00:13,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:13,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:13,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:13,766 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f2be26e990ead654643aaf65441192a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:13,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ef7d7d834df6c5d0bacd2e9dc81ee442, NAME => 'testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-19 21:00:13,766 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676840413185.f2be26e990ead654643aaf65441192a7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413766"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840413766"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840413766"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840413766"}]},"ts":"1676840413766"} 2023-02-19 21:00:13,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:13,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:13,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:13,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:13,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:13,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:13,767 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=c527b46dbc0a90273281c1e9126cddf7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:13,767 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413767"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840413767"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840413767"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840413767"}]},"ts":"1676840413767"} 2023-02-19 21:00:13,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-19 21:00:13,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure f2be26e990ead654643aaf65441192a7, server=jenkins-hbase4.apache.org,35055,1676840411835 in 254 msec 2023-02-19 21:00:13,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-19 21:00:13,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f2be26e990ead654643aaf65441192a7, ASSIGN in 444 msec 2023-02-19 21:00:13,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure c527b46dbc0a90273281c1e9126cddf7, server=jenkins-hbase4.apache.org,44177,1676840411784 in 274 msec 2023-02-19 21:00:13,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c527b46dbc0a90273281c1e9126cddf7, ASSIGN in 445 msec 2023-02-19 21:00:13,780 INFO [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:13,782 DEBUG [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f1 2023-02-19 21:00:13,782 DEBUG [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f1 2023-02-19 21:00:13,782 INFO [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef7d7d834df6c5d0bacd2e9dc81ee442 columnFamilyName f1 2023-02-19 21:00:13,783 INFO [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] regionserver.HStore(310): Store=ef7d7d834df6c5d0bacd2e9dc81ee442/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,783 INFO [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:13,784 DEBUG [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f2 2023-02-19 21:00:13,784 DEBUG [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f2 2023-02-19 21:00:13,784 INFO [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef7d7d834df6c5d0bacd2e9dc81ee442 columnFamilyName f2 2023-02-19 21:00:13,785 INFO [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] regionserver.HStore(310): Store=ef7d7d834df6c5d0bacd2e9dc81ee442/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:13,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:13,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:13,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:13,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:13,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:13,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ef7d7d834df6c5d0bacd2e9dc81ee442; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62880467, jitterRate=-0.06300802528858185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:13,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ef7d7d834df6c5d0bacd2e9dc81ee442: 2023-02-19 21:00:13,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442., pid=27, masterSystemTime=1676840413666 2023-02-19 21:00:13,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:13,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:13,797 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ef7d7d834df6c5d0bacd2e9dc81ee442, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:13,797 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676840413797"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840413797"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840413797"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840413797"}]},"ts":"1676840413797"} 2023-02-19 21:00:13,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:13,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-19 21:00:13,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure ef7d7d834df6c5d0bacd2e9dc81ee442, server=jenkins-hbase4.apache.org,35055,1676840411835 in 287 msec 2023-02-19 21:00:13,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-19 21:00:13,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ef7d7d834df6c5d0bacd2e9dc81ee442, ASSIGN in 474 msec 2023-02-19 21:00:13,809 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 21:00:13,809 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840413809"}]},"ts":"1676840413809"} 2023-02-19 21:00:13,811 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-19 21:00:13,813 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 21:00:13,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 627 msec 2023-02-19 21:00:14,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:14,300 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-19 21:00:14,300 DEBUG [Listener at localhost/36139] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-19 21:00:14,300 INFO [Listener at localhost/36139] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 21:00:14,305 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-19 21:00:14,305 INFO [Listener at localhost/36139] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 21:00:14,305 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-19 21:00:14,305 INFO [Listener at localhost/36139] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 21:00:14,356 DEBUG [hconnection-0x6a4a45fe-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:14,373 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44177] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:14,376 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:14,389 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35055] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:14,480 INFO [Listener at localhost/36139] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 21:00:14,480 INFO [Listener at localhost/36139] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 21:00:14,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 21:00:14,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676840414482 (current time:1676840414482). 2023-02-19 21:00:14,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 21:00:14,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] zookeeper.ReadOnlyZKClient(139): Connect 0x728335b9 to 127.0.0.1:61730 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:14,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@682db993, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:14,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:14,495 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36354, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:14,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x728335b9 to 127.0.0.1:61730 2023-02-19 21:00:14,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:14,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 21:00:14,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 21:00:14,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 21:00:14,501 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 21:00:14,501 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676841014501 2023-02-19 21:00:14,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 21:00:14,503 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-19 21:00:14,504 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 21:00:14,504 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:14,505 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 21:00:14,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 21:00:14,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-19 21:00:14,506 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 21:00:14,507 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676841014507 2023-02-19 21:00:14,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,525 INFO [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-19 21:00:14,525 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:14,526 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-19 21:00:14,526 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-19 21:00:14,526 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,526 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,529 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:14,529 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:14,529 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:14,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:14,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:14,529 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:14,529 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,530 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:14,530 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:14,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-19 21:00:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,531 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-19 21:00:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-19 21:00:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,531 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-19 21:00:14,531 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,531 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,532 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-19 21:00:14,532 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:14,532 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-19 21:00:14,536 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-19 21:00:14,536 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-19 21:00:14,536 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:14,536 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35055,1676840411835' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-19 21:00:14,537 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-19 21:00:14,537 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-19 21:00:14,537 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44177,1676840411784' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-19 21:00:14,539 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,539 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:14,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:14,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:14,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:14,540 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:14,540 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,540 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:14,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:14,540 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:14,540 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,540 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:14,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:14,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:14,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35055,1676840411835' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-19 21:00:14,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cdad803[Count = 1] remaining members to acquire global barrier 2023-02-19 21:00:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:14,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:14,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:14,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:14,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:14,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:14,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44177,1676840411784' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-19 21:00:14,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cdad803[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:14,545 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-19 21:00:14,545 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,546 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,546 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,546 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-19 21:00:14,546 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-19 21:00:14,547 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:14,547 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:14,547 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. started... 2023-02-19 21:00:14,547 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:14,547 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. started... 2023-02-19 21:00:14,547 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:14,547 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:14,552 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:14,553 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:14,553 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 21:00:14,553 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:14,553 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 132935b55b8490ef4f53379a26bb84bf 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 21:00:14,553 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ef7d7d834df6c5d0bacd2e9dc81ee442 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 21:00:14,553 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. started... 2023-02-19 21:00:14,556 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:14,556 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 21:00:14,557 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 21:00:14,553 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. started... 2023-02-19 21:00:14,553 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 21:00:14,553 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. started... 2023-02-19 21:00:14,558 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 649375b1437b5fbbb0130997c03b9237 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 21:00:14,557 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. started... 2023-02-19 21:00:14,557 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 1da2cc8fe80be9b38c7437909b2d1984 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 21:00:14,560 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 08c6b158dfb3a9845f2b1ed3bfbca488 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 21:00:14,559 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1fb3b210b79863f4f4a657bdc1348340: 2023-02-19 21:00:14,561 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,562 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:14,562 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 21:00:14,562 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 21:00:14,605 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:14,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 21:00:14,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 21:00:14,606 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 21:00:14,638 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/.tmp/f1/f17ddee192254c9b8d174b73bddb3800 2023-02-19 21:00:14,645 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/.tmp/f1/7393c2f3b86640fa80f67ed585ca272e 2023-02-19 21:00:14,660 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. completed. 2023-02-19 21:00:14,660 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:14,660 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:14,660 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. started... 2023-02-19 21:00:14,663 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8b67ff68656c504e3a3240f0c555682e: 2023-02-19 21:00:14,663 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,663 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:14,663 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 21:00:14,663 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 21:00:14,664 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/.tmp/f1/1771bcd19bb74e208cf1c4299d24b95a 2023-02-19 21:00:14,664 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 21:00:14,665 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/.tmp/f1/72c6062815474d51869c63a9ef85c05e 2023-02-19 21:00:14,672 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/.tmp/f1/b2c896563a50407da7070510dd63416d 2023-02-19 21:00:14,725 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. completed. 2023-02-19 21:00:14,725 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:14,725 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/.tmp/f2/10b3a6ba730a4bf68bf27dc8e49a5a2c 2023-02-19 21:00:14,725 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 21:00:14,725 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:14,726 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. started... 2023-02-19 21:00:14,726 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c527b46dbc0a90273281c1e9126cddf7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 21:00:14,737 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/.tmp/f1/7393c2f3b86640fa80f67ed585ca272e as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f1/7393c2f3b86640fa80f67ed585ca272e 2023-02-19 21:00:14,749 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f1/7393c2f3b86640fa80f67ed585ca272e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:14,751 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/.tmp/f2/10b3a6ba730a4bf68bf27dc8e49a5a2c as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f2/10b3a6ba730a4bf68bf27dc8e49a5a2c 2023-02-19 21:00:14,759 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/.tmp/f2/9da3819cf6aa4efb8128bcb0e74bff1f 2023-02-19 21:00:14,762 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f2/10b3a6ba730a4bf68bf27dc8e49a5a2c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:14,764 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 132935b55b8490ef4f53379a26bb84bf in 211ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:14,764 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-19 21:00:14,765 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 132935b55b8490ef4f53379a26bb84bf: 2023-02-19 21:00:14,765 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,765 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:14,765 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f1/7393c2f3b86640fa80f67ed585ca272e] hfiles 2023-02-19 21:00:14,765 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f1/7393c2f3b86640fa80f67ed585ca272e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,765 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f2/10b3a6ba730a4bf68bf27dc8e49a5a2c] hfiles 2023-02-19 21:00:14,765 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f2/10b3a6ba730a4bf68bf27dc8e49a5a2c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,769 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/.tmp/f1/f17ddee192254c9b8d174b73bddb3800 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f1/f17ddee192254c9b8d174b73bddb3800 2023-02-19 21:00:14,787 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f1/f17ddee192254c9b8d174b73bddb3800, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 21:00:14,789 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/.tmp/f2/9da3819cf6aa4efb8128bcb0e74bff1f as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f2/9da3819cf6aa4efb8128bcb0e74bff1f 2023-02-19 21:00:14,807 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:14,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 21:00:14,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 21:00:14,809 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-19 21:00:14,812 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/.tmp/f2/4fe28d170a444251a648bb4aafcd6e52 2023-02-19 21:00:14,816 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/.tmp/f2/caf2a827bf7e4f2d9dabbac66a87f1d3 2023-02-19 21:00:14,820 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/.tmp/f1/b2c896563a50407da7070510dd63416d as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f1/b2c896563a50407da7070510dd63416d 2023-02-19 21:00:14,822 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f2/9da3819cf6aa4efb8128bcb0e74bff1f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 21:00:14,824 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ef7d7d834df6c5d0bacd2e9dc81ee442 in 271ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:14,827 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f1/b2c896563a50407da7070510dd63416d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:14,828 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/.tmp/f2/4fe28d170a444251a648bb4aafcd6e52 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f2/4fe28d170a444251a648bb4aafcd6e52 2023-02-19 21:00:14,832 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/.tmp/f1/1771bcd19bb74e208cf1c4299d24b95a as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f1/1771bcd19bb74e208cf1c4299d24b95a 2023-02-19 21:00:14,836 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f2/4fe28d170a444251a648bb4aafcd6e52, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:14,837 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/.tmp/f2/66d81caa4c7d401b96cd0ac71cfe58e8 2023-02-19 21:00:14,837 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 08c6b158dfb3a9845f2b1ed3bfbca488 in 277ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:14,843 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f1/1771bcd19bb74e208cf1c4299d24b95a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 21:00:14,844 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/.tmp/f2/caf2a827bf7e4f2d9dabbac66a87f1d3 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f2/caf2a827bf7e4f2d9dabbac66a87f1d3 2023-02-19 21:00:14,846 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/.tmp/f1/72c6062815474d51869c63a9ef85c05e as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f1/72c6062815474d51869c63a9ef85c05e 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 08c6b158dfb3a9845f2b1ed3bfbca488: 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ef7d7d834df6c5d0bacd2e9dc81ee442: 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f1/b2c896563a50407da7070510dd63416d] hfiles 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f1/f17ddee192254c9b8d174b73bddb3800] hfiles 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f1/f17ddee192254c9b8d174b73bddb3800 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f1/b2c896563a50407da7070510dd63416d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f2/9da3819cf6aa4efb8128bcb0e74bff1f] hfiles 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f2/9da3819cf6aa4efb8128bcb0e74bff1f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f2/4fe28d170a444251a648bb4aafcd6e52] hfiles 2023-02-19 21:00:14,853 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f2/4fe28d170a444251a648bb4aafcd6e52 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,856 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f2/caf2a827bf7e4f2d9dabbac66a87f1d3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 21:00:14,857 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 649375b1437b5fbbb0130997c03b9237 in 299ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:14,857 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 649375b1437b5fbbb0130997c03b9237: 2023-02-19 21:00:14,857 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,857 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:14,857 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f1/1771bcd19bb74e208cf1c4299d24b95a] hfiles 2023-02-19 21:00:14,857 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f1/1771bcd19bb74e208cf1c4299d24b95a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,857 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f2/caf2a827bf7e4f2d9dabbac66a87f1d3] hfiles 2023-02-19 21:00:14,857 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f2/caf2a827bf7e4f2d9dabbac66a87f1d3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,861 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. completed. 2023-02-19 21:00:14,861 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:14,861 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 21:00:14,867 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f1/72c6062815474d51869c63a9ef85c05e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:14,867 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/.tmp/f2/66d81caa4c7d401b96cd0ac71cfe58e8 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f2/66d81caa4c7d401b96cd0ac71cfe58e8 2023-02-19 21:00:14,873 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/.tmp/f1/3be7c60c33ee480d93b988a384e3e438 2023-02-19 21:00:14,873 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f2/66d81caa4c7d401b96cd0ac71cfe58e8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:14,874 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1da2cc8fe80be9b38c7437909b2d1984 in 317ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:14,874 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. completed. 2023-02-19 21:00:14,874 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:14,874 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1da2cc8fe80be9b38c7437909b2d1984: 2023-02-19 21:00:14,875 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 21:00:14,875 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:14,875 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,875 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. started... 2023-02-19 21:00:14,875 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:14,875 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HRegion(2744): Flushing fd61472f7d2cfb0dde552bda55e96c63 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 21:00:14,875 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f1/72c6062815474d51869c63a9ef85c05e] hfiles 2023-02-19 21:00:14,875 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f1/72c6062815474d51869c63a9ef85c05e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,875 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f2/66d81caa4c7d401b96cd0ac71cfe58e8] hfiles 2023-02-19 21:00:14,875 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f2/66d81caa4c7d401b96cd0ac71cfe58e8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,880 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. completed. 2023-02-19 21:00:14,880 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:14,880 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 21:00:14,900 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. completed. 2023-02-19 21:00:14,900 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:14,900 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:14,900 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 21:00:14,900 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. started... 2023-02-19 21:00:14,900 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HRegion(2744): Flushing f2be26e990ead654643aaf65441192a7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 21:00:14,903 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/.tmp/f2/ed752093815f49a2b240ea633ed5c3f2 2023-02-19 21:00:14,912 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/.tmp/f1/abf8b49ff2ee4a5093b360aea45f6fdb 2023-02-19 21:00:14,923 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/.tmp/f1/3be7c60c33ee480d93b988a384e3e438 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f1/3be7c60c33ee480d93b988a384e3e438 2023-02-19 21:00:14,933 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/.tmp/f1/b04a477c68944081ac31c8c6177746bc 2023-02-19 21:00:14,937 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f1/3be7c60c33ee480d93b988a384e3e438, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:14,940 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/.tmp/f2/ed752093815f49a2b240ea633ed5c3f2 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f2/ed752093815f49a2b240ea633ed5c3f2 2023-02-19 21:00:14,950 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f2/ed752093815f49a2b240ea633ed5c3f2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:14,951 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c527b46dbc0a90273281c1e9126cddf7 in 225ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:14,951 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c527b46dbc0a90273281c1e9126cddf7: 2023-02-19 21:00:14,951 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,951 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:14,951 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f1/3be7c60c33ee480d93b988a384e3e438] hfiles 2023-02-19 21:00:14,951 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f1/3be7c60c33ee480d93b988a384e3e438 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,952 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f2/ed752093815f49a2b240ea633ed5c3f2] hfiles 2023-02-19 21:00:14,952 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f2/ed752093815f49a2b240ea633ed5c3f2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:14,986 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/.tmp/f2/651d3ce3f47e4e0d8e1852a001d9b6af 2023-02-19 21:00:14,993 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. completed. 2023-02-19 21:00:14,994 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:14,994 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 21:00:14,994 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 21:00:14,994 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:14,994 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-19 21:00:14,994 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,44177,1676840411784' in zk 2023-02-19 21:00:14,996 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/.tmp/f1/abf8b49ff2ee4a5093b360aea45f6fdb as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f1/abf8b49ff2ee4a5093b360aea45f6fdb 2023-02-19 21:00:14,997 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/.tmp/f2/0857bf0cd1864f8f905cfac964ad6318 2023-02-19 21:00:14,998 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-19 21:00:14,998 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:14,998 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-19 21:00:14,998 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:15,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:15,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:15,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:15,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:15,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,44177,1676840411784': 2023-02-19 21:00:15,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44177,1676840411784' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-19 21:00:15,006 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f1/abf8b49ff2ee4a5093b360aea45f6fdb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:15,008 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/.tmp/f1/b04a477c68944081ac31c8c6177746bc as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f1/b04a477c68944081ac31c8c6177746bc 2023-02-19 21:00:15,008 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/.tmp/f2/651d3ce3f47e4e0d8e1852a001d9b6af as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f2/651d3ce3f47e4e0d8e1852a001d9b6af 2023-02-19 21:00:15,014 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f1/b04a477c68944081ac31c8c6177746bc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:15,014 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f2/651d3ce3f47e4e0d8e1852a001d9b6af, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:15,015 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/.tmp/f2/0857bf0cd1864f8f905cfac964ad6318 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f2/0857bf0cd1864f8f905cfac964ad6318 2023-02-19 21:00:15,015 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fd61472f7d2cfb0dde552bda55e96c63 in 140ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:15,016 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fd61472f7d2cfb0dde552bda55e96c63: 2023-02-19 21:00:15,016 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,016 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:15,016 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f1/abf8b49ff2ee4a5093b360aea45f6fdb] hfiles 2023-02-19 21:00:15,016 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f1/abf8b49ff2ee4a5093b360aea45f6fdb for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,016 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f2/651d3ce3f47e4e0d8e1852a001d9b6af] hfiles 2023-02-19 21:00:15,016 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f2/651d3ce3f47e4e0d8e1852a001d9b6af for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,021 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f2/0857bf0cd1864f8f905cfac964ad6318, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:15,023 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f2be26e990ead654643aaf65441192a7 in 123ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:15,023 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f2be26e990ead654643aaf65441192a7: 2023-02-19 21:00:15,024 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,024 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:15,024 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f1/b04a477c68944081ac31c8c6177746bc] hfiles 2023-02-19 21:00:15,024 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f1/b04a477c68944081ac31c8c6177746bc for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,024 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f2/0857bf0cd1864f8f905cfac964ad6318] hfiles 2023-02-19 21:00:15,024 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f2/0857bf0cd1864f8f905cfac964ad6318 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,046 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. completed. 2023-02-19 21:00:15,047 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:15,047 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 21:00:15,055 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. completed. 2023-02-19 21:00:15,055 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:15,055 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 21:00:15,109 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:15,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 21:00:15,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 21:00:15,112 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-19 21:00:15,291 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. completed. 2023-02-19 21:00:15,291 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:15,291 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 21:00:15,291 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 21:00:15,291 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,291 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-19 21:00:15,291 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,35055,1676840411835' in zk 2023-02-19 21:00:15,293 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-19 21:00:15,293 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,293 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:15,293 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-19 21:00:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:15,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,35055,1676840411835': 2023-02-19 21:00:15,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35055,1676840411835' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-19 21:00:15,298 INFO [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-19 21:00:15,298 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:15,298 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:15,298 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,298 INFO [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 21:00:15,299 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,299 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,299 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:15,299 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:15,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:15,300 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:15,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:15,300 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:15,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:15,300 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:15,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,302 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:15,303 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,310 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,310 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:15,310 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:15,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:15,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:15,310 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:15,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:15,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:15,310 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:15,310 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,310 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,310 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:15,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:15,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:15,311 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,312 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:15,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:15,312 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,312 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,312 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,312 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,312 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-19 21:00:15,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,607 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:15,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676840414503Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676840415311 (+808 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676840415312 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676840415321 (+9 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676840415336 (+15 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676840415607 (+271 ms) 2023-02-19 21:00:15,609 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 21:00:15,610 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1050 sec 2023-02-19 21:00:15,612 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:15,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 21:00:15,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 21:00:15,614 INFO [Listener at localhost/36139] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 21:00:15,618 INFO [Listener at localhost/36139] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 21:00:15,626 INFO [Listener at localhost/36139] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 21:00:15,661 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44177] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:15,670 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35055] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:15,748 INFO [Listener at localhost/36139] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 21:00:15,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 21:00:15,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-19 21:00:15,759 INFO [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-19 21:00:15,759 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:15,760 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-19 21:00:15,760 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-19 21:00:15,761 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:15,761 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:15,762 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:15,762 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:15,762 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:15,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:15,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:15,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:15,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:15,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:15,763 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,763 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:15,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:15,763 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:15,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:15,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:15,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:15,763 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:15,764 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 21:00:15,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:15,764 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 21:00:15,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 21:00:15,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 21:00:15,764 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 21:00:15,764 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 21:00:15,764 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:15,764 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:15,765 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 21:00:15,766 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 21:00:15,768 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:15,768 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. started... 2023-02-19 21:00:15,768 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 132935b55b8490ef4f53379a26bb84bf 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:15,769 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:15,769 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. started... 2023-02-19 21:00:15,769 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1fb3b210b79863f4f4a657bdc1348340: 2023-02-19 21:00:15,769 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:15,769 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:15,770 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:15,772 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. started... 2023-02-19 21:00:15,770 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:15,772 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1da2cc8fe80be9b38c7437909b2d1984 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:15,770 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:15,772 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. started... 2023-02-19 21:00:15,772 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 649375b1437b5fbbb0130997c03b9237 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 21:00:15,770 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 21:00:15,773 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 21:00:15,770 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. started... 2023-02-19 21:00:15,770 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:15,770 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 21:00:15,773 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. started... 2023-02-19 21:00:15,773 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ef7d7d834df6c5d0bacd2e9dc81ee442 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 21:00:15,773 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8b67ff68656c504e3a3240f0c555682e: 2023-02-19 21:00:15,772 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. started... 2023-02-19 21:00:15,773 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:15,773 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 21:00:15,773 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 08c6b158dfb3a9845f2b1ed3bfbca488 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:15,773 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 21:00:15,773 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 21:00:15,773 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:15,773 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. started... 2023-02-19 21:00:15,774 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c527b46dbc0a90273281c1e9126cddf7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:15,816 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/.tmp/f1/f37bc847fabb48e2a36ea9a152bd7585 2023-02-19 21:00:15,827 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/.tmp/f1/a132309f7bd9445ea88f0ea09e0fd7ef 2023-02-19 21:00:15,839 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/.tmp/f1/c54c776a93db42dd9282238739a5353b 2023-02-19 21:00:15,842 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/.tmp/f1/c7e45b4ee78943c6ab4d00c015ccea20 2023-02-19 21:00:15,845 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/.tmp/f1/c11f8cb1f4704a418853bd8e9d01758d 2023-02-19 21:00:15,847 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/.tmp/f1/2062ba110e0346c2950d18e1c6448318 2023-02-19 21:00:15,852 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/.tmp/f2/79f23e1e859544b082a5088815a1f25f 2023-02-19 21:00:15,853 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/.tmp/f2/03169fbd8f1644809229870d4dc7ba56 2023-02-19 21:00:15,864 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/.tmp/f1/a132309f7bd9445ea88f0ea09e0fd7ef as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f1/a132309f7bd9445ea88f0ea09e0fd7ef 2023-02-19 21:00:15,866 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/.tmp/f1/f37bc847fabb48e2a36ea9a152bd7585 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f1/f37bc847fabb48e2a36ea9a152bd7585 2023-02-19 21:00:15,869 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/.tmp/f2/75361ac296b74940a5c8bbe341098868 2023-02-19 21:00:15,872 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f1/a132309f7bd9445ea88f0ea09e0fd7ef, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:15,872 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/.tmp/f2/98fb9bfc6c864f63a5ec571da9dea1a5 2023-02-19 21:00:15,873 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/.tmp/f2/03169fbd8f1644809229870d4dc7ba56 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f2/03169fbd8f1644809229870d4dc7ba56 2023-02-19 21:00:15,875 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/.tmp/f2/bd44c24da0ac48cca1bbdd3f8d815ac7 2023-02-19 21:00:15,877 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f1/f37bc847fabb48e2a36ea9a152bd7585, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:15,877 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/.tmp/f1/c54c776a93db42dd9282238739a5353b as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f1/c54c776a93db42dd9282238739a5353b 2023-02-19 21:00:15,878 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/.tmp/f2/79f23e1e859544b082a5088815a1f25f as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f2/79f23e1e859544b082a5088815a1f25f 2023-02-19 21:00:15,879 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/.tmp/f1/c7e45b4ee78943c6ab4d00c015ccea20 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f1/c7e45b4ee78943c6ab4d00c015ccea20 2023-02-19 21:00:15,887 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f2/03169fbd8f1644809229870d4dc7ba56, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:15,887 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/.tmp/f1/c11f8cb1f4704a418853bd8e9d01758d as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f1/c11f8cb1f4704a418853bd8e9d01758d 2023-02-19 21:00:15,888 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c527b46dbc0a90273281c1e9126cddf7 in 115ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:15,888 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c527b46dbc0a90273281c1e9126cddf7: 2023-02-19 21:00:15,888 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:15,889 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 21:00:15,889 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f2/79f23e1e859544b082a5088815a1f25f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:15,890 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1da2cc8fe80be9b38c7437909b2d1984 in 118ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:15,890 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1da2cc8fe80be9b38c7437909b2d1984: 2023-02-19 21:00:15,890 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:15,890 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:15,890 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 21:00:15,890 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. started... 2023-02-19 21:00:15,891 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing fd61472f7d2cfb0dde552bda55e96c63 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:15,897 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f1/c11f8cb1f4704a418853bd8e9d01758d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 21:00:15,898 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f1/c54c776a93db42dd9282238739a5353b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:15,898 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f1/c7e45b4ee78943c6ab4d00c015ccea20, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:15,900 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/.tmp/f2/75361ac296b74940a5c8bbe341098868 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f2/75361ac296b74940a5c8bbe341098868 2023-02-19 21:00:15,900 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/.tmp/f2/98fb9bfc6c864f63a5ec571da9dea1a5 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f2/98fb9bfc6c864f63a5ec571da9dea1a5 2023-02-19 21:00:15,900 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/.tmp/f2/bd44c24da0ac48cca1bbdd3f8d815ac7 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f2/bd44c24da0ac48cca1bbdd3f8d815ac7 2023-02-19 21:00:15,907 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f2/75361ac296b74940a5c8bbe341098868, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:15,909 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f2/98fb9bfc6c864f63a5ec571da9dea1a5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:15,909 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 132935b55b8490ef4f53379a26bb84bf in 141ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:15,909 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 132935b55b8490ef4f53379a26bb84bf: 2023-02-19 21:00:15,909 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:15,909 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 21:00:15,909 INFO [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 08c6b158dfb3a9845f2b1ed3bfbca488 in 136ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:15,909 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 08c6b158dfb3a9845f2b1ed3bfbca488: 2023-02-19 21:00:15,910 DEBUG [rs(jenkins-hbase4.apache.org,44177,1676840411784)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:15,910 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 21:00:15,910 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 21:00:15,910 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,912 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 21:00:15,912 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44177,1676840411784' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 21:00:15,914 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:15,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:15,915 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:15,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:15,916 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:15,916 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:15,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44177,1676840411784' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 21:00:15,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78e54340[Count = 1] remaining members to acquire global barrier 2023-02-19 21:00:15,930 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f2/bd44c24da0ac48cca1bbdd3f8d815ac7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 21:00:15,931 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ef7d7d834df6c5d0bacd2e9dc81ee442 in 158ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:15,931 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ef7d7d834df6c5d0bacd2e9dc81ee442: 2023-02-19 21:00:15,931 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:15,931 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:15,931 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. started... 2023-02-19 21:00:15,931 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 21:00:15,931 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f2be26e990ead654643aaf65441192a7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:15,933 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/.tmp/f1/02e2eee994a94ae58304e97cc79c5f0e 2023-02-19 21:00:15,960 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/.tmp/f1/6493c2116f0d4fe9a5c7dc14685f1194 2023-02-19 21:00:15,963 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/.tmp/f2/d55f7852926a4018ae7191d8fa0f1120 2023-02-19 21:00:15,969 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/.tmp/f1/02e2eee994a94ae58304e97cc79c5f0e as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f1/02e2eee994a94ae58304e97cc79c5f0e 2023-02-19 21:00:15,974 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f1/02e2eee994a94ae58304e97cc79c5f0e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:15,975 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/.tmp/f2/d55f7852926a4018ae7191d8fa0f1120 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f2/d55f7852926a4018ae7191d8fa0f1120 2023-02-19 21:00:15,983 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/.tmp/f2/a058881feb68458587b8154b50d55843 2023-02-19 21:00:15,983 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f2/d55f7852926a4018ae7191d8fa0f1120, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:15,984 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fd61472f7d2cfb0dde552bda55e96c63 in 93ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:15,984 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fd61472f7d2cfb0dde552bda55e96c63: 2023-02-19 21:00:15,984 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:15,984 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 21:00:15,992 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/.tmp/f1/6493c2116f0d4fe9a5c7dc14685f1194 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f1/6493c2116f0d4fe9a5c7dc14685f1194 2023-02-19 21:00:15,998 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f1/6493c2116f0d4fe9a5c7dc14685f1194, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:15,999 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/.tmp/f2/a058881feb68458587b8154b50d55843 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f2/a058881feb68458587b8154b50d55843 2023-02-19 21:00:16,006 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f2/a058881feb68458587b8154b50d55843, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:16,007 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f2be26e990ead654643aaf65441192a7 in 76ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:16,007 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f2be26e990ead654643aaf65441192a7: 2023-02-19 21:00:16,008 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:16,008 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 21:00:16,287 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/.tmp/f2/01304300dcc0491f8f317007a82aa0e2 2023-02-19 21:00:16,293 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/.tmp/f1/2062ba110e0346c2950d18e1c6448318 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f1/2062ba110e0346c2950d18e1c6448318 2023-02-19 21:00:16,297 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f1/2062ba110e0346c2950d18e1c6448318, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 21:00:16,298 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/.tmp/f2/01304300dcc0491f8f317007a82aa0e2 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f2/01304300dcc0491f8f317007a82aa0e2 2023-02-19 21:00:16,303 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f2/01304300dcc0491f8f317007a82aa0e2, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 21:00:16,304 INFO [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 649375b1437b5fbbb0130997c03b9237 in 532ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:16,304 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 649375b1437b5fbbb0130997c03b9237: 2023-02-19 21:00:16,304 DEBUG [rs(jenkins-hbase4.apache.org,35055,1676840411835)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:16,304 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 21:00:16,304 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 21:00:16,304 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,304 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 21:00:16,304 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35055,1676840411835' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 21:00:16,306 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,306 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:16,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:16,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:16,306 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:16,306 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:16,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:16,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35055,1676840411835' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 21:00:16,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78e54340[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:16,308 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-19 21:00:16,308 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:16,309 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:16,309 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:16,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:16,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:16,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:16,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:16,309 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 21:00:16,309 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 21:00:16,309 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 21:00:16,309 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,309 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35055,1676840411835' in zk 2023-02-19 21:00:16,309 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 21:00:16,310 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44177,1676840411784' in zk 2023-02-19 21:00:16,310 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,310 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:16,312 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 21:00:16,312 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,312 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:16,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:16,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:16,312 DEBUG [member: 'jenkins-hbase4.apache.org,35055,1676840411835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 21:00:16,313 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 21:00:16,313 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,313 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:16,314 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676840411784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 21:00:16,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:16,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:16,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35055,1676840411835': 2023-02-19 21:00:16,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35055,1676840411835' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-19 21:00:16,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:16,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:16,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:16,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:16,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44177,1676840411784': 2023-02-19 21:00:16,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44177,1676840411784' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-19 21:00:16,320 INFO [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-19 21:00:16,320 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:16,320 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:16,320 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-19 21:00:16,320 INFO [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 21:00:16,321 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:16,322 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:16,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:16,322 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:16,322 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:16,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:16,322 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:16,322 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:16,322 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:16,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,328 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,328 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:16,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,331 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,331 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:16,331 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:16,331 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,331 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:16,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:16,331 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:16,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-19 21:00:16,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 21:00:16,331 DEBUG [(jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:16,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:16,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:16,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:16,331 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:16,331 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:16,332 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,332 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:16,333 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 21:00:16,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:16,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:16,332 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:16,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:16,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:16,333 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,333 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:16,333 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:16,433 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 21:00:16,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 21:00:16,435 INFO [Listener at localhost/36139] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 21:00:16,435 DEBUG [Listener at localhost/36139] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0086a8ce to 127.0.0.1:61730 2023-02-19 21:00:16,435 DEBUG [Listener at localhost/36139] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:16,435 DEBUG [Listener at localhost/36139] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 21:00:16,435 DEBUG [Listener at localhost/36139] util.JVMClusterUtil(257): Found active master hash=722638212, stopped=false 2023-02-19 21:00:16,436 INFO [Listener at localhost/36139] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35303,1676840411728 2023-02-19 21:00:16,438 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:16,438 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:16,438 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:16,438 INFO [Listener at localhost/36139] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 21:00:16,438 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:16,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:16,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:16,440 DEBUG [Listener at localhost/36139] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bfeada8 to 127.0.0.1:61730 2023-02-19 21:00:16,441 DEBUG [Listener at localhost/36139] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:16,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:16,441 INFO [Listener at localhost/36139] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44177,1676840411784' ***** 2023-02-19 21:00:16,441 INFO [Listener at localhost/36139] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:16,441 INFO [Listener at localhost/36139] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35055,1676840411835' ***** 2023-02-19 21:00:16,441 INFO [Listener at localhost/36139] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:16,441 INFO [RS:0;jenkins-hbase4:44177] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:16,441 INFO [RS:1;jenkins-hbase4:35055] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:16,441 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:16,441 INFO [RS:1;jenkins-hbase4:35055] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:16,442 INFO [RS:0;jenkins-hbase4:44177] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:16,441 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:16,442 INFO [RS:0;jenkins-hbase4:44177] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:16,442 INFO [RS:1;jenkins-hbase4:35055] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:16,443 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(3304): Received CLOSE for 132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:16,443 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(3304): Received CLOSE for ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:16,443 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(3304): Received CLOSE for 1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:16,443 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(3304): Received CLOSE for 8940e87a9ffbc633376da75959cc7ec5 2023-02-19 21:00:16,443 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(3304): Received CLOSE for 08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:16,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 132935b55b8490ef4f53379a26bb84bf, disabling compactions & flushes 2023-02-19 21:00:16,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ef7d7d834df6c5d0bacd2e9dc81ee442, disabling compactions & flushes 2023-02-19 21:00:16,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:16,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:16,443 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(3304): Received CLOSE for 8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:16,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:16,443 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(3304): Received CLOSE for c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:16,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. after waiting 0 ms 2023-02-19 21:00:16,443 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:16,444 DEBUG [RS:0;jenkins-hbase4:44177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a9711c2 to 127.0.0.1:61730 2023-02-19 21:00:16,443 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(3304): Received CLOSE for 1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:16,444 DEBUG [RS:0;jenkins-hbase4:44177] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:16,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:16,444 INFO [RS:0;jenkins-hbase4:44177] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:16,444 INFO [RS:0;jenkins-hbase4:44177] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:16,444 INFO [RS:0;jenkins-hbase4:44177] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:16,444 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(3304): Received CLOSE for 649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:16,444 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 21:00:16,444 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(3304): Received CLOSE for fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:16,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. after waiting 0 ms 2023-02-19 21:00:16,444 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(3304): Received CLOSE for f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:16,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:16,445 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,445 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-19 21:00:16,446 DEBUG [RS:1;jenkins-hbase4:35055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62b4e752 to 127.0.0.1:61730 2023-02-19 21:00:16,447 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:16,447 DEBUG [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(1479): Online Regions={132935b55b8490ef4f53379a26bb84bf=testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf., 1fb3b210b79863f4f4a657bdc1348340=testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340., 08c6b158dfb3a9845f2b1ed3bfbca488=testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488., 8b67ff68656c504e3a3240f0c555682e=testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e., 1588230740=hbase:meta,,1.1588230740, c527b46dbc0a90273281c1e9126cddf7=testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7.} 2023-02-19 21:00:16,447 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:16,447 DEBUG [RS:1;jenkins-hbase4:35055] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:16,447 DEBUG [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(1505): Waiting on 08c6b158dfb3a9845f2b1ed3bfbca488, 132935b55b8490ef4f53379a26bb84bf, 1588230740, 1fb3b210b79863f4f4a657bdc1348340, 8b67ff68656c504e3a3240f0c555682e, c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:16,447 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-19 21:00:16,447 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:16,448 DEBUG [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(1479): Online Regions={ef7d7d834df6c5d0bacd2e9dc81ee442=testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442., 8940e87a9ffbc633376da75959cc7ec5=hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5., 1da2cc8fe80be9b38c7437909b2d1984=testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984., 649375b1437b5fbbb0130997c03b9237=testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237., fd61472f7d2cfb0dde552bda55e96c63=testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63., f2be26e990ead654643aaf65441192a7=testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7.} 2023-02-19 21:00:16,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:16,451 DEBUG [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(1505): Waiting on 1da2cc8fe80be9b38c7437909b2d1984, 649375b1437b5fbbb0130997c03b9237, 8940e87a9ffbc633376da75959cc7ec5, ef7d7d834df6c5d0bacd2e9dc81ee442, f2be26e990ead654643aaf65441192a7, fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:16,452 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:16,452 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-19 21:00:16,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:16,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:16,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ef7d7d834df6c5d0bacd2e9dc81ee442: 2023-02-19 21:00:16,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:16,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:16,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8940e87a9ffbc633376da75959cc7ec5, disabling compactions & flushes 2023-02-19 21:00:16,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. 2023-02-19 21:00:16,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. 2023-02-19 21:00:16,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. after waiting 0 ms 2023-02-19 21:00:16,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. 2023-02-19 21:00:16,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 8940e87a9ffbc633376da75959cc7ec5 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 21:00:16,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:16,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 132935b55b8490ef4f53379a26bb84bf: 2023-02-19 21:00:16,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:16,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1fb3b210b79863f4f4a657bdc1348340, disabling compactions & flushes 2023-02-19 21:00:16,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:16,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:16,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. after waiting 0 ms 2023-02-19 21:00:16,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:16,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 21:00:16,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:16,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1fb3b210b79863f4f4a657bdc1348340: 2023-02-19 21:00:16,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:16,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 08c6b158dfb3a9845f2b1ed3bfbca488, disabling compactions & flushes 2023-02-19 21:00:16,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:16,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:16,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. after waiting 0 ms 2023-02-19 21:00:16,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:16,469 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/.tmp/info/24822cd22b204d40bd9e025b7f43f75b 2023-02-19 21:00:16,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5/.tmp/info/5977fe0ca7a24b729116101510edb2f5 2023-02-19 21:00:16,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:16,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:16,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 08c6b158dfb3a9845f2b1ed3bfbca488: 2023-02-19 21:00:16,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:16,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8b67ff68656c504e3a3240f0c555682e, disabling compactions & flushes 2023-02-19 21:00:16,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:16,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:16,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. after waiting 0 ms 2023-02-19 21:00:16,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:16,478 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:16,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 21:00:16,481 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:16,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5/.tmp/info/5977fe0ca7a24b729116101510edb2f5 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5/info/5977fe0ca7a24b729116101510edb2f5 2023-02-19 21:00:16,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:16,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8b67ff68656c504e3a3240f0c555682e: 2023-02-19 21:00:16,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:16,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c527b46dbc0a90273281c1e9126cddf7, disabling compactions & flushes 2023-02-19 21:00:16,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:16,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:16,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. after waiting 0 ms 2023-02-19 21:00:16,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:16,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:16,494 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/.tmp/table/caf3715630de46b8bb18eb27f362633a 2023-02-19 21:00:16,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5/info/5977fe0ca7a24b729116101510edb2f5, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 21:00:16,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:16,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c527b46dbc0a90273281c1e9126cddf7: 2023-02-19 21:00:16,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:16,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8940e87a9ffbc633376da75959cc7ec5 in 39ms, sequenceid=6, compaction requested=false 2023-02-19 21:00:16,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-19 21:00:16,501 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/.tmp/info/24822cd22b204d40bd9e025b7f43f75b as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/info/24822cd22b204d40bd9e025b7f43f75b 2023-02-19 21:00:16,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/namespace/8940e87a9ffbc633376da75959cc7ec5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 21:00:16,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. 2023-02-19 21:00:16,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8940e87a9ffbc633376da75959cc7ec5: 2023-02-19 21:00:16,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676840412575.8940e87a9ffbc633376da75959cc7ec5. 2023-02-19 21:00:16,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1da2cc8fe80be9b38c7437909b2d1984, disabling compactions & flushes 2023-02-19 21:00:16,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:16,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:16,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. after waiting 0 ms 2023-02-19 21:00:16,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:16,506 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/info/24822cd22b204d40bd9e025b7f43f75b, entries=110, sequenceid=32, filesize=18.7 K 2023-02-19 21:00:16,507 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/.tmp/table/caf3715630de46b8bb18eb27f362633a as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/table/caf3715630de46b8bb18eb27f362633a 2023-02-19 21:00:16,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:16,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:16,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1da2cc8fe80be9b38c7437909b2d1984: 2023-02-19 21:00:16,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:16,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 649375b1437b5fbbb0130997c03b9237, disabling compactions & flushes 2023-02-19 21:00:16,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:16,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:16,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. after waiting 0 ms 2023-02-19 21:00:16,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:16,512 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/table/caf3715630de46b8bb18eb27f362633a, entries=4, sequenceid=32, filesize=4.8 K 2023-02-19 21:00:16,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:16,513 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 61ms, sequenceid=32, compaction requested=false 2023-02-19 21:00:16,513 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-19 21:00:16,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:16,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 649375b1437b5fbbb0130997c03b9237: 2023-02-19 21:00:16,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:16,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fd61472f7d2cfb0dde552bda55e96c63, disabling compactions & flushes 2023-02-19 21:00:16,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:16,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:16,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. after waiting 0 ms 2023-02-19 21:00:16,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:16,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:16,517 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-19 21:00:16,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:16,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fd61472f7d2cfb0dde552bda55e96c63: 2023-02-19 21:00:16,518 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 21:00:16,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:16,518 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:16,518 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:16,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f2be26e990ead654643aaf65441192a7, disabling compactions & flushes 2023-02-19 21:00:16,518 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:16,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:16,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:16,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. after waiting 0 ms 2023-02-19 21:00:16,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:16,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:16,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:16,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f2be26e990ead654643aaf65441192a7: 2023-02-19 21:00:16,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:16,647 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44177,1676840411784; all regions closed. 2023-02-19 21:00:16,652 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35055,1676840411835; all regions closed. 2023-02-19 21:00:16,653 DEBUG [RS:0;jenkins-hbase4:44177] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/oldWALs 2023-02-19 21:00:16,654 INFO [RS:0;jenkins-hbase4:44177] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44177%2C1676840411784.meta:.meta(num 1676840412485) 2023-02-19 21:00:16,659 DEBUG [RS:1;jenkins-hbase4:35055] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/oldWALs 2023-02-19 21:00:16,659 INFO [RS:1;jenkins-hbase4:35055] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35055%2C1676840411835:(num 1676840412983) 2023-02-19 21:00:16,659 DEBUG [RS:1;jenkins-hbase4:35055] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:16,659 INFO [RS:1;jenkins-hbase4:35055] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:16,659 INFO [RS:1;jenkins-hbase4:35055] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:16,659 INFO [RS:1;jenkins-hbase4:35055] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:16,659 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:16,659 INFO [RS:1;jenkins-hbase4:35055] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:16,659 INFO [RS:1;jenkins-hbase4:35055] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:16,660 INFO [RS:1;jenkins-hbase4:35055] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35055 2023-02-19 21:00:16,662 DEBUG [RS:0;jenkins-hbase4:44177] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/oldWALs 2023-02-19 21:00:16,662 INFO [RS:0;jenkins-hbase4:44177] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44177%2C1676840411784:(num 1676840413185) 2023-02-19 21:00:16,662 DEBUG [RS:0;jenkins-hbase4:44177] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:16,662 INFO [RS:0;jenkins-hbase4:44177] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:16,663 INFO [RS:0;jenkins-hbase4:44177] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:16,663 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:16,663 INFO [RS:0;jenkins-hbase4:44177] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44177 2023-02-19 21:00:16,665 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:16,665 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,665 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35055,1676840411835 2023-02-19 21:00:16,665 ERROR [Listener at localhost/36139-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35ead582 rejected from java.util.concurrent.ThreadPoolExecutor@31d557e7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:16,665 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:16,665 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:16,665 ERROR [Listener at localhost/36139-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26cc9c30 rejected from java.util.concurrent.ThreadPoolExecutor@31d557e7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:16,666 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,666 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44177,1676840411784 2023-02-19 21:00:16,666 ERROR [Listener at localhost/36139-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e18169b rejected from java.util.concurrent.ThreadPoolExecutor@31d557e7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:16,666 ERROR [Listener at localhost/36139-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71fc4295 rejected from java.util.concurrent.ThreadPoolExecutor@75c3d872[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:16,666 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44177,1676840411784] 2023-02-19 21:00:16,666 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44177,1676840411784; numProcessing=1 2023-02-19 21:00:16,668 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44177,1676840411784 already deleted, retry=false 2023-02-19 21:00:16,668 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44177,1676840411784 expired; onlineServers=1 2023-02-19 21:00:16,668 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35055,1676840411835] 2023-02-19 21:00:16,668 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35055,1676840411835; numProcessing=2 2023-02-19 21:00:16,670 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35055,1676840411835 already deleted, retry=false 2023-02-19 21:00:16,670 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35055,1676840411835 expired; onlineServers=0 2023-02-19 21:00:16,670 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35303,1676840411728' ***** 2023-02-19 21:00:16,670 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 21:00:16,671 DEBUG [M:0;jenkins-hbase4:35303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a2f9fbf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:16,671 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35303,1676840411728 2023-02-19 21:00:16,671 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35303,1676840411728; all regions closed. 2023-02-19 21:00:16,671 DEBUG [M:0;jenkins-hbase4:35303] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:16,671 DEBUG [M:0;jenkins-hbase4:35303] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 21:00:16,671 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 21:00:16,671 DEBUG [M:0;jenkins-hbase4:35303] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 21:00:16,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840412051] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840412051,5,FailOnTimeoutGroup] 2023-02-19 21:00:16,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840412051] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840412051,5,FailOnTimeoutGroup] 2023-02-19 21:00:16,672 INFO [M:0;jenkins-hbase4:35303] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 21:00:16,673 INFO [M:0;jenkins-hbase4:35303] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 21:00:16,673 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:16,673 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:16,673 INFO [M:0;jenkins-hbase4:35303] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 21:00:16,674 DEBUG [M:0;jenkins-hbase4:35303] master.HMaster(1512): Stopping service threads 2023-02-19 21:00:16,674 INFO [M:0;jenkins-hbase4:35303] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 21:00:16,674 ERROR [M:0;jenkins-hbase4:35303] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 21:00:16,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:16,674 INFO [M:0;jenkins-hbase4:35303] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 21:00:16,674 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 21:00:16,675 DEBUG [M:0;jenkins-hbase4:35303] zookeeper.ZKUtil(398): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 21:00:16,675 WARN [M:0;jenkins-hbase4:35303] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 21:00:16,675 INFO [M:0;jenkins-hbase4:35303] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 21:00:16,675 INFO [M:0;jenkins-hbase4:35303] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 21:00:16,675 DEBUG [M:0;jenkins-hbase4:35303] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:16,675 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:16,675 DEBUG [M:0;jenkins-hbase4:35303] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:16,675 DEBUG [M:0;jenkins-hbase4:35303] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:16,675 DEBUG [M:0;jenkins-hbase4:35303] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:16,676 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-19 21:00:16,686 INFO [M:0;jenkins-hbase4:35303] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bc968371120944dbbde8b8a7c179ba87 2023-02-19 21:00:16,691 DEBUG [M:0;jenkins-hbase4:35303] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bc968371120944dbbde8b8a7c179ba87 as hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bc968371120944dbbde8b8a7c179ba87 2023-02-19 21:00:16,700 INFO [M:0;jenkins-hbase4:35303] regionserver.HStore(1080): Added hdfs://localhost:43691/user/jenkins/test-data/1e2ea971-8853-b5b9-97d4-c4dd3adacbfa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bc968371120944dbbde8b8a7c179ba87, entries=31, sequenceid=218, filesize=9.0 K 2023-02-19 21:00:16,701 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=218, compaction requested=false 2023-02-19 21:00:16,701 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:16,702 DEBUG [M:0;jenkins-hbase4:35303] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:16,705 INFO [M:0;jenkins-hbase4:35303] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 21:00:16,705 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:16,706 INFO [M:0;jenkins-hbase4:35303] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35303 2023-02-19 21:00:16,709 DEBUG [M:0;jenkins-hbase4:35303] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35303,1676840411728 already deleted, retry=false 2023-02-19 21:00:16,939 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:16,939 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35303,1676840411728; zookeeper connection closed. 2023-02-19 21:00:16,939 ERROR [Listener at localhost/36139-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a278846 rejected from java.util.concurrent.ThreadPoolExecutor@4e1815da[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:16,940 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1006e620bf10000, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:16,940 ERROR [Listener at localhost/36139-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c48a89a rejected from java.util.concurrent.ThreadPoolExecutor@4e1815da[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:16,957 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 21:00:17,039 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:17,039 INFO [RS:0;jenkins-hbase4:44177] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44177,1676840411784; zookeeper connection closed. 2023-02-19 21:00:17,039 ERROR [Listener at localhost/36139-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12c05e17 rejected from java.util.concurrent.ThreadPoolExecutor@75c3d872[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:17,039 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e620bf10001, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:17,039 ERROR [Listener at localhost/36139-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6ad0162d rejected from java.util.concurrent.ThreadPoolExecutor@75c3d872[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:17,039 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1e379f29] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1e379f29 2023-02-19 21:00:17,139 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:17,139 INFO [RS:1;jenkins-hbase4:35055] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35055,1676840411835; zookeeper connection closed. 2023-02-19 21:00:17,139 ERROR [Listener at localhost/36139-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56170345 rejected from java.util.concurrent.ThreadPoolExecutor@31d557e7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:17,140 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:35055-0x1006e620bf10002, quorum=127.0.0.1:61730, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:17,140 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@77984a92] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@77984a92 2023-02-19 21:00:17,140 ERROR [Listener at localhost/36139-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@451cbf62 rejected from java.util.concurrent.ThreadPoolExecutor@31d557e7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:17,140 INFO [Listener at localhost/36139] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 21:00:17,242 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/hadoop-3967392854376650810.jar 2023-02-19 21:00:17,248 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676840414482 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:17,248 DEBUG [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce 2023-02-19 21:00:17,248 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(239): region to add: 132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:17,249 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(239): region to add: 08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:17,249 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(239): region to add: 8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:17,249 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(239): region to add: 1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:17,249 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(239): region to add: ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:17,249 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(239): region to add: 1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:17,249 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(239): region to add: 649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:17,249 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(239): region to add: fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:17,249 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(239): region to add: f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:17,249 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(239): region to add: c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:17,249 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(585): clone region=132935b55b8490ef4f53379a26bb84bf as 132935b55b8490ef4f53379a26bb84bf in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:17,249 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(585): clone region=08c6b158dfb3a9845f2b1ed3bfbca488 as 08c6b158dfb3a9845f2b1ed3bfbca488 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:17,250 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(585): clone region=8b67ff68656c504e3a3240f0c555682e as 8b67ff68656c504e3a3240f0c555682e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:17,250 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(585): clone region=1fb3b210b79863f4f4a657bdc1348340 as 1fb3b210b79863f4f4a657bdc1348340 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:17,250 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(585): clone region=ef7d7d834df6c5d0bacd2e9dc81ee442 as ef7d7d834df6c5d0bacd2e9dc81ee442 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:17,250 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(585): clone region=1da2cc8fe80be9b38c7437909b2d1984 as 1da2cc8fe80be9b38c7437909b2d1984 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:17,250 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(585): clone region=649375b1437b5fbbb0130997c03b9237 as 649375b1437b5fbbb0130997c03b9237 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:17,250 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(585): clone region=fd61472f7d2cfb0dde552bda55e96c63 as fd61472f7d2cfb0dde552bda55e96c63 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:17,250 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(585): clone region=f2be26e990ead654643aaf65441192a7 as f2be26e990ead654643aaf65441192a7 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:17,250 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(585): clone region=c527b46dbc0a90273281c1e9126cddf7 as c527b46dbc0a90273281c1e9126cddf7 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 21:00:17,251 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 132935b55b8490ef4f53379a26bb84bf, NAME => 'testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb 2023-02-19 21:00:17,251 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 08c6b158dfb3a9845f2b1ed3bfbca488, NAME => 'testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb 2023-02-19 21:00:17,252 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8b67ff68656c504e3a3240f0c555682e, NAME => 'testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb 2023-02-19 21:00:17,254 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ef7d7d834df6c5d0bacd2e9dc81ee442, NAME => 'testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb 2023-02-19 21:00:17,254 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 649375b1437b5fbbb0130997c03b9237, NAME => 'testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb 2023-02-19 21:00:17,254 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 1fb3b210b79863f4f4a657bdc1348340, NAME => 'testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb 2023-02-19 21:00:17,254 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 1da2cc8fe80be9b38c7437909b2d1984, NAME => 'testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb 2023-02-19 21:00:17,260 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => fd61472f7d2cfb0dde552bda55e96c63, NAME => 'testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb 2023-02-19 21:00:17,290 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:17,290 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b2c896563a50407da7070510dd63416d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,291 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:17,291 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink abf8b49ff2ee4a5093b360aea45f6fdb from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,292 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:17,292 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 8b67ff68656c504e3a3240f0c555682e, disabling compactions & flushes 2023-02-19 21:00:17,292 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:17,292 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:17,292 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. after waiting 0 ms 2023-02-19 21:00:17,292 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:17,292 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:17,292 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 8b67ff68656c504e3a3240f0c555682e: 2023-02-19 21:00:17,293 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => f2be26e990ead654643aaf65441192a7, NAME => 'testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb 2023-02-19 21:00:17,294 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4fe28d170a444251a648bb4aafcd6e52 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,295 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 651d3ce3f47e4e0d8e1852a001d9b6af from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,299 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:17,299 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:17,299 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f17ddee192254c9b8d174b73bddb3800 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,299 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1771bcd19bb74e208cf1c4299d24b95a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,299 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 08c6b158dfb3a9845f2b1ed3bfbca488, disabling compactions & flushes 2023-02-19 21:00:17,299 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:17,299 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:17,299 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. after waiting 0 ms 2023-02-19 21:00:17,299 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:17,300 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:17,300 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 08c6b158dfb3a9845f2b1ed3bfbca488: 2023-02-19 21:00:17,300 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => c527b46dbc0a90273281c1e9126cddf7, NAME => 'testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb 2023-02-19 21:00:17,301 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing fd61472f7d2cfb0dde552bda55e96c63, disabling compactions & flushes 2023-02-19 21:00:17,301 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:17,301 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:17,301 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. after waiting 0 ms 2023-02-19 21:00:17,301 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:17,301 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:17,301 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for fd61472f7d2cfb0dde552bda55e96c63: 2023-02-19 21:00:17,302 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9da3819cf6aa4efb8128bcb0e74bff1f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,303 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink caf2a827bf7e4f2d9dabbac66a87f1d3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,305 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:17,305 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b04a477c68944081ac31c8c6177746bc from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,305 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ef7d7d834df6c5d0bacd2e9dc81ee442, disabling compactions & flushes 2023-02-19 21:00:17,305 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:17,305 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:17,305 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. after waiting 0 ms 2023-02-19 21:00:17,305 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:17,305 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:17,305 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ef7d7d834df6c5d0bacd2e9dc81ee442: 2023-02-19 21:00:17,307 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 649375b1437b5fbbb0130997c03b9237, disabling compactions & flushes 2023-02-19 21:00:17,307 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:17,307 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:17,307 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. after waiting 0 ms 2023-02-19 21:00:17,307 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:17,307 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:17,307 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 649375b1437b5fbbb0130997c03b9237: 2023-02-19 21:00:17,308 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0857bf0cd1864f8f905cfac964ad6318 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,310 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing f2be26e990ead654643aaf65441192a7, disabling compactions & flushes 2023-02-19 21:00:17,310 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:17,310 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:17,310 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. after waiting 0 ms 2023-02-19 21:00:17,310 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:17,310 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:17,310 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for f2be26e990ead654643aaf65441192a7: 2023-02-19 21:00:17,311 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:17,311 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3be7c60c33ee480d93b988a384e3e438 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,314 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ed752093815f49a2b240ea633ed5c3f2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,316 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing c527b46dbc0a90273281c1e9126cddf7, disabling compactions & flushes 2023-02-19 21:00:17,316 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:17,316 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:17,317 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. after waiting 0 ms 2023-02-19 21:00:17,317 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:17,317 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:17,317 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for c527b46dbc0a90273281c1e9126cddf7: 2023-02-19 21:00:17,687 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:17,687 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7393c2f3b86640fa80f67ed585ca272e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,688 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:17,688 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 1fb3b210b79863f4f4a657bdc1348340, disabling compactions & flushes 2023-02-19 21:00:17,688 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:17,688 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:17,688 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. after waiting 0 ms 2023-02-19 21:00:17,688 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:17,688 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:17,688 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 1fb3b210b79863f4f4a657bdc1348340: 2023-02-19 21:00:17,690 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 10b3a6ba730a4bf68bf27dc8e49a5a2c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,691 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:17,692 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 72c6062815474d51869c63a9ef85c05e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,692 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 132935b55b8490ef4f53379a26bb84bf, disabling compactions & flushes 2023-02-19 21:00:17,692 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:17,692 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:17,692 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. after waiting 0 ms 2023-02-19 21:00:17,692 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:17,692 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:17,692 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 132935b55b8490ef4f53379a26bb84bf: 2023-02-19 21:00:17,694 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 66d81caa4c7d401b96cd0ac71cfe58e8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 21:00:17,695 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 1da2cc8fe80be9b38c7437909b2d1984, disabling compactions & flushes 2023-02-19 21:00:17,695 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:17,696 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:17,696 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. after waiting 0 ms 2023-02-19 21:00:17,696 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:17,696 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:17,696 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 1da2cc8fe80be9b38c7437909b2d1984: 2023-02-19 21:00:17,696 INFO [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676840414482 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:17,696 DEBUG [Listener at localhost/36139] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb 2023-02-19 21:00:17,696 DEBUG [Listener at localhost/36139] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb 2023-02-19 21:00:17,697 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-data/ 2023-02-19 21:00:17,698 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |----default/ 2023-02-19 21:00:17,698 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-19 21:00:17,699 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |----------08c6b158dfb3a9845f2b1ed3bfbca488/ 2023-02-19 21:00:17,700 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:17,700 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:17,700 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=08c6b158dfb3a9845f2b1ed3bfbca488-b2c896563a50407da7070510dd63416d 2023-02-19 21:00:17,701 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:17,701 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=08c6b158dfb3a9845f2b1ed3bfbca488-4fe28d170a444251a648bb4aafcd6e52 2023-02-19 21:00:17,701 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |----------132935b55b8490ef4f53379a26bb84bf/ 2023-02-19 21:00:17,702 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:17,702 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:17,702 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=132935b55b8490ef4f53379a26bb84bf-7393c2f3b86640fa80f67ed585ca272e 2023-02-19 21:00:17,702 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:17,702 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=132935b55b8490ef4f53379a26bb84bf-10b3a6ba730a4bf68bf27dc8e49a5a2c 2023-02-19 21:00:17,702 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |----------1da2cc8fe80be9b38c7437909b2d1984/ 2023-02-19 21:00:17,703 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:17,703 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:17,703 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=1da2cc8fe80be9b38c7437909b2d1984-72c6062815474d51869c63a9ef85c05e 2023-02-19 21:00:17,703 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:17,704 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=1da2cc8fe80be9b38c7437909b2d1984-66d81caa4c7d401b96cd0ac71cfe58e8 2023-02-19 21:00:17,704 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |----------1fb3b210b79863f4f4a657bdc1348340/ 2023-02-19 21:00:17,704 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:17,704 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |----------649375b1437b5fbbb0130997c03b9237/ 2023-02-19 21:00:17,705 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:17,705 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:17,705 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=649375b1437b5fbbb0130997c03b9237-1771bcd19bb74e208cf1c4299d24b95a 2023-02-19 21:00:17,705 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:17,706 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=649375b1437b5fbbb0130997c03b9237-caf2a827bf7e4f2d9dabbac66a87f1d3 2023-02-19 21:00:17,706 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |----------8b67ff68656c504e3a3240f0c555682e/ 2023-02-19 21:00:17,707 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:17,707 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |----------c527b46dbc0a90273281c1e9126cddf7/ 2023-02-19 21:00:17,707 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:17,707 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:17,708 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=c527b46dbc0a90273281c1e9126cddf7-3be7c60c33ee480d93b988a384e3e438 2023-02-19 21:00:17,708 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:17,709 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=c527b46dbc0a90273281c1e9126cddf7-ed752093815f49a2b240ea633ed5c3f2 2023-02-19 21:00:17,709 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |----------ef7d7d834df6c5d0bacd2e9dc81ee442/ 2023-02-19 21:00:17,709 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:17,709 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:17,710 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=ef7d7d834df6c5d0bacd2e9dc81ee442-f17ddee192254c9b8d174b73bddb3800 2023-02-19 21:00:17,710 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:17,711 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=ef7d7d834df6c5d0bacd2e9dc81ee442-9da3819cf6aa4efb8128bcb0e74bff1f 2023-02-19 21:00:17,711 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |----------f2be26e990ead654643aaf65441192a7/ 2023-02-19 21:00:17,711 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:17,711 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:17,712 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=f2be26e990ead654643aaf65441192a7-b04a477c68944081ac31c8c6177746bc 2023-02-19 21:00:17,712 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:17,712 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=f2be26e990ead654643aaf65441192a7-0857bf0cd1864f8f905cfac964ad6318 2023-02-19 21:00:17,712 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |----------fd61472f7d2cfb0dde552bda55e96c63/ 2023-02-19 21:00:17,713 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:17,713 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:17,713 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=fd61472f7d2cfb0dde552bda55e96c63-abf8b49ff2ee4a5093b360aea45f6fdb 2023-02-19 21:00:17,713 DEBUG [Listener at localhost/36139] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:17,714 DEBUG [Listener at localhost/36139] util.CommonFSUtils(702): |----------------testWithMapReduce=fd61472f7d2cfb0dde552bda55e96c63-651d3ce3f47e4e0d8e1852a001d9b6af 2023-02-19 21:00:17,714 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:17,715 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:17,715 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:17,715 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:18,651 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/hadoop-6927955147803494609.jar 2023-02-19 21:00:18,651 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:18,652 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:18,718 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/hadoop-1960553276924135958.jar 2023-02-19 21:00:18,718 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:18,718 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:18,719 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:18,719 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:18,720 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:18,720 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:18,720 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-19 21:00:18,721 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-19 21:00:18,721 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-19 21:00:18,722 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-19 21:00:18,722 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-19 21:00:18,722 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-19 21:00:18,723 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-19 21:00:18,723 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-19 21:00:18,723 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-19 21:00:18,724 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-19 21:00:18,724 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:18,725 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 21:00:18,725 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 21:00:18,725 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 21:00:18,726 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 21:00:18,792 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/hadoop-1151606674288951536.jar 2023-02-19 21:00:18,792 DEBUG [Listener at localhost/36139] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 21:00:18,797 WARN [Listener at localhost/36139] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-19 21:00:18,803 WARN [Listener at localhost/36139] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-19 21:00:18,810 INFO [Listener at localhost/36139] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 21:00:18,911 WARN [Listener at localhost/36139] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/mapreduce.cluster.local.dir/1676840418880/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-19 21:00:18,912 WARN [Listener at localhost/36139] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/mapreduce.cluster.local.dir/1676840418880/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-19 21:00:18,962 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:18,963 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:18,969 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:18,971 INFO [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:18,972 DEBUG [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f1 2023-02-19 21:00:18,973 INFO [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08c6b158dfb3a9845f2b1ed3bfbca488 columnFamilyName f1 2023-02-19 21:00:18,985 DEBUG [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f1/testWithMapReduce=08c6b158dfb3a9845f2b1ed3bfbca488-b2c896563a50407da7070510dd63416d 2023-02-19 21:00:18,985 INFO [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] regionserver.HStore(310): Store=08c6b158dfb3a9845f2b1ed3bfbca488/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:18,985 INFO [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08c6b158dfb3a9845f2b1ed3bfbca488 2023-02-19 21:00:18,988 DEBUG [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f2 2023-02-19 21:00:18,989 INFO [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08c6b158dfb3a9845f2b1ed3bfbca488 columnFamilyName f2 2023-02-19 21:00:18,999 DEBUG [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/08c6b158dfb3a9845f2b1ed3bfbca488/f2/testWithMapReduce=08c6b158dfb3a9845f2b1ed3bfbca488-4fe28d170a444251a648bb4aafcd6e52 2023-02-19 21:00:19,000 INFO [StoreOpener-08c6b158dfb3a9845f2b1ed3bfbca488-1] regionserver.HStore(310): Store=08c6b158dfb3a9845f2b1ed3bfbca488/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,000 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:19,000 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 08c6b158dfb3a9845f2b1ed3bfbca488; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61127261, jitterRate=-0.08913283050060272}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:19,000 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 08c6b158dfb3a9845f2b1ed3bfbca488: 2023-02-19 21:00:19,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 08c6b158dfb3a9845f2b1ed3bfbca488, disabling compactions & flushes 2023-02-19 21:00:19,031 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:19,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:19,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. after waiting 0 ms 2023-02-19 21:00:19,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:19,032 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676840413185.08c6b158dfb3a9845f2b1ed3bfbca488. 2023-02-19 21:00:19,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 08c6b158dfb3a9845f2b1ed3bfbca488: 2023-02-19 21:00:19,036 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:19,036 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:19,041 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:19,043 INFO [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:19,044 DEBUG [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f1 2023-02-19 21:00:19,045 INFO [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 132935b55b8490ef4f53379a26bb84bf columnFamilyName f1 2023-02-19 21:00:19,051 DEBUG [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f1/testWithMapReduce=132935b55b8490ef4f53379a26bb84bf-7393c2f3b86640fa80f67ed585ca272e 2023-02-19 21:00:19,051 INFO [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] regionserver.HStore(310): Store=132935b55b8490ef4f53379a26bb84bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,051 INFO [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 132935b55b8490ef4f53379a26bb84bf 2023-02-19 21:00:19,052 DEBUG [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f2 2023-02-19 21:00:19,053 INFO [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 132935b55b8490ef4f53379a26bb84bf columnFamilyName f2 2023-02-19 21:00:19,058 DEBUG [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/132935b55b8490ef4f53379a26bb84bf/f2/testWithMapReduce=132935b55b8490ef4f53379a26bb84bf-10b3a6ba730a4bf68bf27dc8e49a5a2c 2023-02-19 21:00:19,058 INFO [StoreOpener-132935b55b8490ef4f53379a26bb84bf-1] regionserver.HStore(310): Store=132935b55b8490ef4f53379a26bb84bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,059 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:19,059 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 132935b55b8490ef4f53379a26bb84bf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61885762, jitterRate=-0.07783028483390808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:19,059 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 132935b55b8490ef4f53379a26bb84bf: 2023-02-19 21:00:19,088 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 132935b55b8490ef4f53379a26bb84bf, disabling compactions & flushes 2023-02-19 21:00:19,089 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:19,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:19,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. after waiting 0 ms 2023-02-19 21:00:19,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:19,090 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676840413185.132935b55b8490ef4f53379a26bb84bf. 2023-02-19 21:00:19,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 132935b55b8490ef4f53379a26bb84bf: 2023-02-19 21:00:19,093 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:19,093 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:19,094 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:19,095 INFO [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:19,097 DEBUG [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e/f1 2023-02-19 21:00:19,097 INFO [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b67ff68656c504e3a3240f0c555682e columnFamilyName f1 2023-02-19 21:00:19,097 INFO [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] regionserver.HStore(310): Store=8b67ff68656c504e3a3240f0c555682e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,098 INFO [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8b67ff68656c504e3a3240f0c555682e 2023-02-19 21:00:19,099 DEBUG [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/8b67ff68656c504e3a3240f0c555682e/f2 2023-02-19 21:00:19,099 INFO [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b67ff68656c504e3a3240f0c555682e columnFamilyName f2 2023-02-19 21:00:19,099 INFO [StoreOpener-8b67ff68656c504e3a3240f0c555682e-1] regionserver.HStore(310): Store=8b67ff68656c504e3a3240f0c555682e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,099 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:19,100 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8b67ff68656c504e3a3240f0c555682e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63714280, jitterRate=-0.05058324337005615}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:19,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8b67ff68656c504e3a3240f0c555682e: 2023-02-19 21:00:19,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8b67ff68656c504e3a3240f0c555682e, disabling compactions & flushes 2023-02-19 21:00:19,129 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:19,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:19,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. after waiting 0 ms 2023-02-19 21:00:19,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:19,130 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676840413185.8b67ff68656c504e3a3240f0c555682e. 2023-02-19 21:00:19,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8b67ff68656c504e3a3240f0c555682e: 2023-02-19 21:00:19,133 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:19,133 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:19,136 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:19,138 INFO [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:19,139 DEBUG [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f1 2023-02-19 21:00:19,139 INFO [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef7d7d834df6c5d0bacd2e9dc81ee442 columnFamilyName f1 2023-02-19 21:00:19,145 DEBUG [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f1/testWithMapReduce=ef7d7d834df6c5d0bacd2e9dc81ee442-f17ddee192254c9b8d174b73bddb3800 2023-02-19 21:00:19,145 INFO [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] regionserver.HStore(310): Store=ef7d7d834df6c5d0bacd2e9dc81ee442/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,145 INFO [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ef7d7d834df6c5d0bacd2e9dc81ee442 2023-02-19 21:00:19,146 DEBUG [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f2 2023-02-19 21:00:19,147 INFO [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef7d7d834df6c5d0bacd2e9dc81ee442 columnFamilyName f2 2023-02-19 21:00:19,152 DEBUG [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/ef7d7d834df6c5d0bacd2e9dc81ee442/f2/testWithMapReduce=ef7d7d834df6c5d0bacd2e9dc81ee442-9da3819cf6aa4efb8128bcb0e74bff1f 2023-02-19 21:00:19,152 INFO [StoreOpener-ef7d7d834df6c5d0bacd2e9dc81ee442-1] regionserver.HStore(310): Store=ef7d7d834df6c5d0bacd2e9dc81ee442/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,152 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:19,152 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ef7d7d834df6c5d0bacd2e9dc81ee442; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65768512, jitterRate=-0.019972801208496094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:19,152 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ef7d7d834df6c5d0bacd2e9dc81ee442: 2023-02-19 21:00:19,199 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ef7d7d834df6c5d0bacd2e9dc81ee442, disabling compactions & flushes 2023-02-19 21:00:19,199 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:19,199 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:19,199 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. after waiting 0 ms 2023-02-19 21:00:19,199 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:19,209 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676840413185.ef7d7d834df6c5d0bacd2e9dc81ee442. 2023-02-19 21:00:19,209 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ef7d7d834df6c5d0bacd2e9dc81ee442: 2023-02-19 21:00:19,213 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:19,213 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:19,217 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:19,219 INFO [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:19,222 DEBUG [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f1 2023-02-19 21:00:19,222 INFO [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1da2cc8fe80be9b38c7437909b2d1984 columnFamilyName f1 2023-02-19 21:00:19,227 DEBUG [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f1/testWithMapReduce=1da2cc8fe80be9b38c7437909b2d1984-72c6062815474d51869c63a9ef85c05e 2023-02-19 21:00:19,227 INFO [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] regionserver.HStore(310): Store=1da2cc8fe80be9b38c7437909b2d1984/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,228 INFO [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1da2cc8fe80be9b38c7437909b2d1984 2023-02-19 21:00:19,228 DEBUG [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f2 2023-02-19 21:00:19,229 INFO [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1da2cc8fe80be9b38c7437909b2d1984 columnFamilyName f2 2023-02-19 21:00:19,234 DEBUG [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/1da2cc8fe80be9b38c7437909b2d1984/f2/testWithMapReduce=1da2cc8fe80be9b38c7437909b2d1984-66d81caa4c7d401b96cd0ac71cfe58e8 2023-02-19 21:00:19,234 INFO [StoreOpener-1da2cc8fe80be9b38c7437909b2d1984-1] regionserver.HStore(310): Store=1da2cc8fe80be9b38c7437909b2d1984/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,234 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:19,235 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1da2cc8fe80be9b38c7437909b2d1984; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65257957, jitterRate=-0.027580663561820984}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:19,235 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1da2cc8fe80be9b38c7437909b2d1984: 2023-02-19 21:00:19,265 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1da2cc8fe80be9b38c7437909b2d1984, disabling compactions & flushes 2023-02-19 21:00:19,266 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:19,266 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:19,266 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. after waiting 0 ms 2023-02-19 21:00:19,266 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:19,268 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676840413185.1da2cc8fe80be9b38c7437909b2d1984. 2023-02-19 21:00:19,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1da2cc8fe80be9b38c7437909b2d1984: 2023-02-19 21:00:19,271 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:19,272 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:19,275 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:19,277 INFO [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:19,278 DEBUG [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f1 2023-02-19 21:00:19,278 INFO [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 649375b1437b5fbbb0130997c03b9237 columnFamilyName f1 2023-02-19 21:00:19,291 DEBUG [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f1/testWithMapReduce=649375b1437b5fbbb0130997c03b9237-1771bcd19bb74e208cf1c4299d24b95a 2023-02-19 21:00:19,291 INFO [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] regionserver.HStore(310): Store=649375b1437b5fbbb0130997c03b9237/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,291 INFO [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 649375b1437b5fbbb0130997c03b9237 2023-02-19 21:00:19,292 DEBUG [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f2 2023-02-19 21:00:19,292 INFO [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 649375b1437b5fbbb0130997c03b9237 columnFamilyName f2 2023-02-19 21:00:19,297 DEBUG [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/649375b1437b5fbbb0130997c03b9237/f2/testWithMapReduce=649375b1437b5fbbb0130997c03b9237-caf2a827bf7e4f2d9dabbac66a87f1d3 2023-02-19 21:00:19,297 INFO [StoreOpener-649375b1437b5fbbb0130997c03b9237-1] regionserver.HStore(310): Store=649375b1437b5fbbb0130997c03b9237/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,297 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:19,297 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 649375b1437b5fbbb0130997c03b9237; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61562138, jitterRate=-0.08265265822410583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:19,297 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 649375b1437b5fbbb0130997c03b9237: 2023-02-19 21:00:19,333 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 649375b1437b5fbbb0130997c03b9237, disabling compactions & flushes 2023-02-19 21:00:19,333 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:19,333 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:19,333 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. after waiting 0 ms 2023-02-19 21:00:19,333 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:19,334 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676840413185.649375b1437b5fbbb0130997c03b9237. 2023-02-19 21:00:19,334 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 649375b1437b5fbbb0130997c03b9237: 2023-02-19 21:00:19,338 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:19,338 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:19,339 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:19,341 INFO [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:19,342 DEBUG [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f1 2023-02-19 21:00:19,343 INFO [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c527b46dbc0a90273281c1e9126cddf7 columnFamilyName f1 2023-02-19 21:00:19,348 DEBUG [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f1/testWithMapReduce=c527b46dbc0a90273281c1e9126cddf7-3be7c60c33ee480d93b988a384e3e438 2023-02-19 21:00:19,348 INFO [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] regionserver.HStore(310): Store=c527b46dbc0a90273281c1e9126cddf7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,348 INFO [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c527b46dbc0a90273281c1e9126cddf7 2023-02-19 21:00:19,349 DEBUG [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f2 2023-02-19 21:00:19,349 INFO [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c527b46dbc0a90273281c1e9126cddf7 columnFamilyName f2 2023-02-19 21:00:19,356 DEBUG [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/c527b46dbc0a90273281c1e9126cddf7/f2/testWithMapReduce=c527b46dbc0a90273281c1e9126cddf7-ed752093815f49a2b240ea633ed5c3f2 2023-02-19 21:00:19,356 INFO [StoreOpener-c527b46dbc0a90273281c1e9126cddf7-1] regionserver.HStore(310): Store=c527b46dbc0a90273281c1e9126cddf7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,356 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:19,356 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c527b46dbc0a90273281c1e9126cddf7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60786538, jitterRate=-0.09420999884605408}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:19,356 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c527b46dbc0a90273281c1e9126cddf7: 2023-02-19 21:00:19,385 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c527b46dbc0a90273281c1e9126cddf7, disabling compactions & flushes 2023-02-19 21:00:19,385 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:19,385 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:19,385 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. after waiting 0 ms 2023-02-19 21:00:19,385 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:19,385 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676840413185.c527b46dbc0a90273281c1e9126cddf7. 2023-02-19 21:00:19,386 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c527b46dbc0a90273281c1e9126cddf7: 2023-02-19 21:00:19,388 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:19,388 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:19,389 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:19,391 INFO [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:19,392 DEBUG [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340/f1 2023-02-19 21:00:19,393 INFO [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1fb3b210b79863f4f4a657bdc1348340 columnFamilyName f1 2023-02-19 21:00:19,393 INFO [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] regionserver.HStore(310): Store=1fb3b210b79863f4f4a657bdc1348340/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,393 INFO [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1fb3b210b79863f4f4a657bdc1348340 2023-02-19 21:00:19,394 DEBUG [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/1fb3b210b79863f4f4a657bdc1348340/f2 2023-02-19 21:00:19,394 INFO [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1fb3b210b79863f4f4a657bdc1348340 columnFamilyName f2 2023-02-19 21:00:19,395 INFO [StoreOpener-1fb3b210b79863f4f4a657bdc1348340-1] regionserver.HStore(310): Store=1fb3b210b79863f4f4a657bdc1348340/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,395 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:19,395 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1fb3b210b79863f4f4a657bdc1348340; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68100305, jitterRate=0.014773622155189514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:19,395 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1fb3b210b79863f4f4a657bdc1348340: 2023-02-19 21:00:19,413 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1fb3b210b79863f4f4a657bdc1348340, disabling compactions & flushes 2023-02-19 21:00:19,413 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:19,413 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:19,413 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. after waiting 0 ms 2023-02-19 21:00:19,413 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:19,413 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676840413185.1fb3b210b79863f4f4a657bdc1348340. 2023-02-19 21:00:19,413 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1fb3b210b79863f4f4a657bdc1348340: 2023-02-19 21:00:19,417 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:19,417 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:19,418 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:19,419 INFO [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:19,420 DEBUG [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f1 2023-02-19 21:00:19,421 INFO [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd61472f7d2cfb0dde552bda55e96c63 columnFamilyName f1 2023-02-19 21:00:19,425 DEBUG [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f1/testWithMapReduce=fd61472f7d2cfb0dde552bda55e96c63-abf8b49ff2ee4a5093b360aea45f6fdb 2023-02-19 21:00:19,425 INFO [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] regionserver.HStore(310): Store=fd61472f7d2cfb0dde552bda55e96c63/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,425 INFO [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fd61472f7d2cfb0dde552bda55e96c63 2023-02-19 21:00:19,426 DEBUG [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f2 2023-02-19 21:00:19,427 INFO [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd61472f7d2cfb0dde552bda55e96c63 columnFamilyName f2 2023-02-19 21:00:19,431 DEBUG [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/fd61472f7d2cfb0dde552bda55e96c63/f2/testWithMapReduce=fd61472f7d2cfb0dde552bda55e96c63-651d3ce3f47e4e0d8e1852a001d9b6af 2023-02-19 21:00:19,431 INFO [StoreOpener-fd61472f7d2cfb0dde552bda55e96c63-1] regionserver.HStore(310): Store=fd61472f7d2cfb0dde552bda55e96c63/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,431 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:19,431 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fd61472f7d2cfb0dde552bda55e96c63; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59798943, jitterRate=-0.10892631113529205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:19,431 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fd61472f7d2cfb0dde552bda55e96c63: 2023-02-19 21:00:19,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fd61472f7d2cfb0dde552bda55e96c63, disabling compactions & flushes 2023-02-19 21:00:19,466 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:19,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:19,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. after waiting 0 ms 2023-02-19 21:00:19,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:19,466 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676840413185.fd61472f7d2cfb0dde552bda55e96c63. 2023-02-19 21:00:19,467 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fd61472f7d2cfb0dde552bda55e96c63: 2023-02-19 21:00:19,469 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:19,469 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:19,470 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:19,472 INFO [StoreOpener-f2be26e990ead654643aaf65441192a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:19,473 DEBUG [StoreOpener-f2be26e990ead654643aaf65441192a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f1 2023-02-19 21:00:19,473 INFO [StoreOpener-f2be26e990ead654643aaf65441192a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2be26e990ead654643aaf65441192a7 columnFamilyName f1 2023-02-19 21:00:19,478 DEBUG [StoreOpener-f2be26e990ead654643aaf65441192a7-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f1/testWithMapReduce=f2be26e990ead654643aaf65441192a7-b04a477c68944081ac31c8c6177746bc 2023-02-19 21:00:19,478 INFO [StoreOpener-f2be26e990ead654643aaf65441192a7-1] regionserver.HStore(310): Store=f2be26e990ead654643aaf65441192a7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,478 INFO [StoreOpener-f2be26e990ead654643aaf65441192a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f2be26e990ead654643aaf65441192a7 2023-02-19 21:00:19,479 DEBUG [StoreOpener-f2be26e990ead654643aaf65441192a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f2 2023-02-19 21:00:19,479 INFO [StoreOpener-f2be26e990ead654643aaf65441192a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2be26e990ead654643aaf65441192a7 columnFamilyName f2 2023-02-19 21:00:19,483 DEBUG [StoreOpener-f2be26e990ead654643aaf65441192a7-1] regionserver.HStore(539): loaded hdfs://localhost:43691/user/jenkins/test-data/341ec25e-6b47-ee19-1be8-c98e7600da82/testWithMapReduceAndOfflineHBaseMultiRegion/efbaa9ce-deb1-4cb5-9cf9-4c65f99c0eeb/data/default/testWithMapReduce/f2be26e990ead654643aaf65441192a7/f2/testWithMapReduce=f2be26e990ead654643aaf65441192a7-0857bf0cd1864f8f905cfac964ad6318 2023-02-19 21:00:19,483 INFO [StoreOpener-f2be26e990ead654643aaf65441192a7-1] regionserver.HStore(310): Store=f2be26e990ead654643aaf65441192a7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:19,484 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:19,484 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f2be26e990ead654643aaf65441192a7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61398528, jitterRate=-0.08509063720703125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:19,484 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f2be26e990ead654643aaf65441192a7: 2023-02-19 21:00:19,511 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f2be26e990ead654643aaf65441192a7, disabling compactions & flushes 2023-02-19 21:00:19,511 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:19,512 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:19,512 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. after waiting 0 ms 2023-02-19 21:00:19,512 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:19,512 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676840413185.f2be26e990ead654643aaf65441192a7. 2023-02-19 21:00:19,512 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f2be26e990ead654643aaf65441192a7: 2023-02-19 21:00:19,961 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 21:00:19,961 WARN [Listener at localhost/36139] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:19,964 INFO [Listener at localhost/36139] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:20,066 WARN [BP-885753594-172.31.14.131-1676840407849 heartbeating to localhost/127.0.0.1:43691] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:20,066 WARN [BP-885753594-172.31.14.131-1676840407849 heartbeating to localhost/127.0.0.1:43691] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-885753594-172.31.14.131-1676840407849 (Datanode Uuid 487f8917-6d94-4abb-af18-b9388c64c547) service to localhost/127.0.0.1:43691 2023-02-19 21:00:20,067 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/cluster_158ecc85-7faa-e6d3-042e-f6f1c86f3a3d/dfs/data/data3/current/BP-885753594-172.31.14.131-1676840407849] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:20,067 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/cluster_158ecc85-7faa-e6d3-042e-f6f1c86f3a3d/dfs/data/data4/current/BP-885753594-172.31.14.131-1676840407849] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:20,068 WARN [Listener at localhost/36139] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:20,074 INFO [Listener at localhost/36139] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:20,178 WARN [BP-885753594-172.31.14.131-1676840407849 heartbeating to localhost/127.0.0.1:43691] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:20,178 WARN [BP-885753594-172.31.14.131-1676840407849 heartbeating to localhost/127.0.0.1:43691] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-885753594-172.31.14.131-1676840407849 (Datanode Uuid fb8cb3b7-8574-479b-8d0c-2b896d705601) service to localhost/127.0.0.1:43691 2023-02-19 21:00:20,179 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/cluster_158ecc85-7faa-e6d3-042e-f6f1c86f3a3d/dfs/data/data1/current/BP-885753594-172.31.14.131-1676840407849] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:20,179 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/cluster_158ecc85-7faa-e6d3-042e-f6f1c86f3a3d/dfs/data/data2/current/BP-885753594-172.31.14.131-1676840407849] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:20,191 INFO [Listener at localhost/36139] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:20,311 INFO [Listener at localhost/36139] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 21:00:20,357 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 21:00:20,369 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=152 (was 103) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35303,1676840411728)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:43691 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36139 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:43691 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:43691 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:43691 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:43691 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:43691 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43691 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=530 (was 542), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=342 (was 365), ProcessCount=170 (was 172), AvailableMemoryMB=9230 (was 9719) 2023-02-19 21:00:20,382 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=152, OpenFileDescriptor=530, MaxFileDescriptor=60000, SystemLoadAverage=342, ProcessCount=170, AvailableMemoryMB=9230 2023-02-19 21:00:20,396 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/hadoop.log.dir so I do NOT create it in target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a 2023-02-19 21:00:20,396 WARN [Listener at localhost/36139] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 21:00:20,396 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/hadoop.tmp.dir so I do NOT create it in target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a 2023-02-19 21:00:20,396 WARN [Listener at localhost/36139] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d9eef75d-06f9-e513-0ad7-da2514a134f3/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 21:00:20,396 DEBUG [Listener at localhost/36139] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a 2023-02-19 21:00:20,396 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 21:00:20,396 INFO [Listener at localhost/36139] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/cluster_3389c8a9-178e-d84a-1f62-6e5be694de70, deleteOnExit=true 2023-02-19 21:00:20,396 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 21:00:20,397 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/test.cache.data in system properties and HBase conf 2023-02-19 21:00:20,397 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 21:00:20,397 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/hadoop.log.dir in system properties and HBase conf 2023-02-19 21:00:20,397 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 21:00:20,397 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 21:00:20,397 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 21:00:20,397 DEBUG [Listener at localhost/36139] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 21:00:20,397 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 21:00:20,397 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 21:00:20,398 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 21:00:20,398 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 21:00:20,398 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 21:00:20,398 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 21:00:20,398 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 21:00:20,398 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 21:00:20,398 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 21:00:20,398 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/nfs.dump.dir in system properties and HBase conf 2023-02-19 21:00:20,398 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/java.io.tmpdir in system properties and HBase conf 2023-02-19 21:00:20,398 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 21:00:20,398 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 21:00:20,398 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 21:00:20,402 WARN [Listener at localhost/36139] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 21:00:20,403 WARN [Listener at localhost/36139] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 21:00:20,463 WARN [Listener at localhost/36139] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:20,465 INFO [Listener at localhost/36139] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:20,472 INFO [Listener at localhost/36139] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/java.io.tmpdir/Jetty_localhost_42881_hdfs____.vpyzxf/webapp 2023-02-19 21:00:20,568 INFO [Listener at localhost/36139] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42881 2023-02-19 21:00:20,572 WARN [Listener at localhost/36139] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 21:00:20,572 WARN [Listener at localhost/36139] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 21:00:20,620 WARN [Listener at localhost/40483] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:20,644 WARN [Listener at localhost/40483] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 21:00:20,647 WARN [Listener at localhost/40483] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:20,649 INFO [Listener at localhost/40483] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:20,658 INFO [Listener at localhost/40483] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/java.io.tmpdir/Jetty_localhost_37297_datanode____ed61n7/webapp 2023-02-19 21:00:20,779 INFO [Listener at localhost/40483] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37297 2023-02-19 21:00:20,792 WARN [Listener at localhost/35567] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:20,804 WARN [Listener at localhost/35567] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 21:00:20,806 WARN [Listener at localhost/35567] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:20,807 INFO [Listener at localhost/35567] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:20,810 INFO [Listener at localhost/35567] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/java.io.tmpdir/Jetty_localhost_44287_datanode____.lcga0/webapp 2023-02-19 21:00:20,894 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x833111c06d325e89: Processing first storage report for DS-d6f018ac-707a-4db3-b7ba-c8e38ca3e9e0 from datanode 0b304073-fcbb-46ee-82aa-3234e191ae46 2023-02-19 21:00:20,894 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x833111c06d325e89: from storage DS-d6f018ac-707a-4db3-b7ba-c8e38ca3e9e0 node DatanodeRegistration(127.0.0.1:39949, datanodeUuid=0b304073-fcbb-46ee-82aa-3234e191ae46, infoPort=43945, infoSecurePort=0, ipcPort=35567, storageInfo=lv=-57;cid=testClusterID;nsid=1033892321;c=1676840420405), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:20,894 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x833111c06d325e89: Processing first storage report for DS-c6fad60a-8794-46d4-9ee7-300f9d1ec41a from datanode 0b304073-fcbb-46ee-82aa-3234e191ae46 2023-02-19 21:00:20,894 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x833111c06d325e89: from storage DS-c6fad60a-8794-46d4-9ee7-300f9d1ec41a node DatanodeRegistration(127.0.0.1:39949, datanodeUuid=0b304073-fcbb-46ee-82aa-3234e191ae46, infoPort=43945, infoSecurePort=0, ipcPort=35567, storageInfo=lv=-57;cid=testClusterID;nsid=1033892321;c=1676840420405), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:20,909 INFO [Listener at localhost/35567] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44287 2023-02-19 21:00:20,916 WARN [Listener at localhost/46375] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:21,023 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed919898b228779f: Processing first storage report for DS-5df8614a-b91c-4ab6-9f24-0876ed52e4e3 from datanode 1712a20c-abd1-429b-992d-9b9788aef1b5 2023-02-19 21:00:21,023 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed919898b228779f: from storage DS-5df8614a-b91c-4ab6-9f24-0876ed52e4e3 node DatanodeRegistration(127.0.0.1:33627, datanodeUuid=1712a20c-abd1-429b-992d-9b9788aef1b5, infoPort=37643, infoSecurePort=0, ipcPort=46375, storageInfo=lv=-57;cid=testClusterID;nsid=1033892321;c=1676840420405), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:21,023 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed919898b228779f: Processing first storage report for DS-3ee2d455-724c-46db-9292-39771078a18e from datanode 1712a20c-abd1-429b-992d-9b9788aef1b5 2023-02-19 21:00:21,023 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed919898b228779f: from storage DS-3ee2d455-724c-46db-9292-39771078a18e node DatanodeRegistration(127.0.0.1:33627, datanodeUuid=1712a20c-abd1-429b-992d-9b9788aef1b5, infoPort=37643, infoSecurePort=0, ipcPort=46375, storageInfo=lv=-57;cid=testClusterID;nsid=1033892321;c=1676840420405), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:21,124 DEBUG [Listener at localhost/46375] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a 2023-02-19 21:00:21,127 INFO [Listener at localhost/46375] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/cluster_3389c8a9-178e-d84a-1f62-6e5be694de70/zookeeper_0, clientPort=60609, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/cluster_3389c8a9-178e-d84a-1f62-6e5be694de70/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/cluster_3389c8a9-178e-d84a-1f62-6e5be694de70/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 21:00:21,128 INFO [Listener at localhost/46375] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60609 2023-02-19 21:00:21,128 INFO [Listener at localhost/46375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:21,130 INFO [Listener at localhost/46375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:21,160 INFO [Listener at localhost/46375] util.FSUtils(479): Created version file at hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64 with version=8 2023-02-19 21:00:21,161 INFO [Listener at localhost/46375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:21,162 INFO [Listener at localhost/46375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:21,163 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40483/user/jenkins/test-data/38bdb3a7-5374-f9a2-2e70-da0089e63942/hbase-staging 2023-02-19 21:00:21,164 INFO [Listener at localhost/46375] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:21,165 INFO [Listener at localhost/46375] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:21,165 INFO [Listener at localhost/46375] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:21,165 INFO [Listener at localhost/46375] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:21,165 INFO [Listener at localhost/46375] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:21,165 INFO [Listener at localhost/46375] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:21,165 INFO [Listener at localhost/46375] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:21,166 INFO [Listener at localhost/46375] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38069 2023-02-19 21:00:21,167 INFO [Listener at localhost/46375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:21,168 INFO [Listener at localhost/46375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:21,169 INFO [Listener at localhost/46375] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38069 connecting to ZooKeeper ensemble=127.0.0.1:60609 2023-02-19 21:00:21,177 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:380690x0, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:21,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38069-0x1006e6230cb0000 connected 2023-02-19 21:00:21,197 DEBUG [Listener at localhost/46375] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:21,197 DEBUG [Listener at localhost/46375] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:21,198 DEBUG [Listener at localhost/46375] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:21,200 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38069 2023-02-19 21:00:21,200 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38069 2023-02-19 21:00:21,200 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38069 2023-02-19 21:00:21,201 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38069 2023-02-19 21:00:21,204 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38069 2023-02-19 21:00:21,204 INFO [Listener at localhost/46375] master.HMaster(444): hbase.rootdir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64, hbase.cluster.distributed=false 2023-02-19 21:00:21,216 INFO [Listener at localhost/46375] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:21,217 INFO [Listener at localhost/46375] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:21,217 INFO [Listener at localhost/46375] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:21,217 INFO [Listener at localhost/46375] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:21,217 INFO [Listener at localhost/46375] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:21,217 INFO [Listener at localhost/46375] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:21,217 INFO [Listener at localhost/46375] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:21,219 INFO [Listener at localhost/46375] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46165 2023-02-19 21:00:21,219 INFO [Listener at localhost/46375] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 21:00:21,220 DEBUG [Listener at localhost/46375] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:21,221 INFO [Listener at localhost/46375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:21,222 INFO [Listener at localhost/46375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:21,223 INFO [Listener at localhost/46375] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46165 connecting to ZooKeeper ensemble=127.0.0.1:60609 2023-02-19 21:00:21,227 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:461650x0, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:21,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46165-0x1006e6230cb0001 connected 2023-02-19 21:00:21,228 DEBUG [Listener at localhost/46375] zookeeper.ZKUtil(164): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:21,229 DEBUG [Listener at localhost/46375] zookeeper.ZKUtil(164): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:21,229 DEBUG [Listener at localhost/46375] zookeeper.ZKUtil(164): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:21,230 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46165 2023-02-19 21:00:21,230 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46165 2023-02-19 21:00:21,232 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46165 2023-02-19 21:00:21,232 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46165 2023-02-19 21:00:21,234 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46165 2023-02-19 21:00:21,245 INFO [Listener at localhost/46375] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:21,245 INFO [Listener at localhost/46375] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:21,245 INFO [Listener at localhost/46375] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:21,245 INFO [Listener at localhost/46375] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:21,245 INFO [Listener at localhost/46375] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:21,245 INFO [Listener at localhost/46375] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:21,246 INFO [Listener at localhost/46375] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:21,248 INFO [Listener at localhost/46375] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43151 2023-02-19 21:00:21,249 INFO [Listener at localhost/46375] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 21:00:21,250 DEBUG [Listener at localhost/46375] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:21,251 INFO [Listener at localhost/46375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:21,251 INFO [Listener at localhost/46375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:21,252 INFO [Listener at localhost/46375] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43151 connecting to ZooKeeper ensemble=127.0.0.1:60609 2023-02-19 21:00:21,256 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:431510x0, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:21,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43151-0x1006e6230cb0002 connected 2023-02-19 21:00:21,258 DEBUG [Listener at localhost/46375] zookeeper.ZKUtil(164): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:21,259 DEBUG [Listener at localhost/46375] zookeeper.ZKUtil(164): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:21,259 DEBUG [Listener at localhost/46375] zookeeper.ZKUtil(164): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:21,260 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43151 2023-02-19 21:00:21,263 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43151 2023-02-19 21:00:21,263 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43151 2023-02-19 21:00:21,263 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43151 2023-02-19 21:00:21,263 DEBUG [Listener at localhost/46375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43151 2023-02-19 21:00:21,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38069,1676840421164 2023-02-19 21:00:21,266 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 21:00:21,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38069,1676840421164 2023-02-19 21:00:21,268 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:21,268 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:21,268 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:21,268 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:21,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 21:00:21,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38069,1676840421164 from backup master directory 2023-02-19 21:00:21,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 21:00:21,271 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38069,1676840421164 2023-02-19 21:00:21,271 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 21:00:21,271 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:21,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38069,1676840421164 2023-02-19 21:00:21,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/hbase.id with ID: 697d5d82-9e07-461e-aec5-aa73d26ae5bb 2023-02-19 21:00:21,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:21,300 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:21,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x78702325 to 127.0.0.1:60609 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:21,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75a6946c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:21,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:21,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 21:00:21,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:21,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/data/master/store-tmp 2023-02-19 21:00:21,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:21,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:21,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:21,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:21,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:21,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:21,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:21,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:21,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/WALs/jenkins-hbase4.apache.org,38069,1676840421164 2023-02-19 21:00:21,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38069%2C1676840421164, suffix=, logDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/WALs/jenkins-hbase4.apache.org,38069,1676840421164, archiveDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/oldWALs, maxLogs=10 2023-02-19 21:00:21,370 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33627,DS-5df8614a-b91c-4ab6-9f24-0876ed52e4e3,DISK] 2023-02-19 21:00:21,370 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39949,DS-d6f018ac-707a-4db3-b7ba-c8e38ca3e9e0,DISK] 2023-02-19 21:00:21,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/WALs/jenkins-hbase4.apache.org,38069,1676840421164/jenkins-hbase4.apache.org%2C38069%2C1676840421164.1676840421349 2023-02-19 21:00:21,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39949,DS-d6f018ac-707a-4db3-b7ba-c8e38ca3e9e0,DISK], DatanodeInfoWithStorage[127.0.0.1:33627,DS-5df8614a-b91c-4ab6-9f24-0876ed52e4e3,DISK]] 2023-02-19 21:00:21,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:21,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:21,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:21,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:21,377 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:21,379 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 21:00:21,379 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 21:00:21,380 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:21,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:21,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:21,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:21,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:21,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59544899, jitterRate=-0.11271186172962189}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 21:00:21,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:21,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 21:00:21,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 21:00:21,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 21:00:21,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 21:00:21,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 21:00:21,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 21:00:21,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 21:00:21,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 21:00:21,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 21:00:21,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 21:00:21,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 21:00:21,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 21:00:21,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 21:00:21,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 21:00:21,407 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:21,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 21:00:21,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 21:00:21,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 21:00:21,410 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:21,410 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:21,410 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:21,410 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:21,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38069,1676840421164, sessionid=0x1006e6230cb0000, setting cluster-up flag (Was=false) 2023-02-19 21:00:21,416 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:21,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 21:00:21,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38069,1676840421164 2023-02-19 21:00:21,427 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:21,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 21:00:21,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38069,1676840421164 2023-02-19 21:00:21,433 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.hbase-snapshot/.tmp 2023-02-19 21:00:21,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:21,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:21,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:21,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:21,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:21,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 21:00:21,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:21,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676840451437 2023-02-19 21:00:21,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 21:00:21,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 21:00:21,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 21:00:21,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 21:00:21,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 21:00:21,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 21:00:21,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,437 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:21,437 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 21:00:21,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 21:00:21,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 21:00:21,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 21:00:21,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 21:00:21,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 21:00:21,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840421438,5,FailOnTimeoutGroup] 2023-02-19 21:00:21,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840421438,5,FailOnTimeoutGroup] 2023-02-19 21:00:21,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 21:00:21,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,439 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:21,447 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:21,448 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:21,448 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64 2023-02-19 21:00:21,466 INFO [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(952): ClusterId : 697d5d82-9e07-461e-aec5-aa73d26ae5bb 2023-02-19 21:00:21,466 DEBUG [RS:1;jenkins-hbase4:43151] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 21:00:21,466 INFO [RS:0;jenkins-hbase4:46165] regionserver.HRegionServer(952): ClusterId : 697d5d82-9e07-461e-aec5-aa73d26ae5bb 2023-02-19 21:00:21,466 DEBUG [RS:0;jenkins-hbase4:46165] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 21:00:21,470 DEBUG [RS:1;jenkins-hbase4:43151] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 21:00:21,471 DEBUG [RS:1;jenkins-hbase4:43151] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 21:00:21,471 DEBUG [RS:0;jenkins-hbase4:46165] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 21:00:21,471 DEBUG [RS:0;jenkins-hbase4:46165] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 21:00:21,476 DEBUG [RS:1;jenkins-hbase4:43151] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 21:00:21,478 DEBUG [RS:1;jenkins-hbase4:43151] zookeeper.ReadOnlyZKClient(139): Connect 0x6137b4a8 to 127.0.0.1:60609 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:21,478 DEBUG [RS:0;jenkins-hbase4:46165] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 21:00:21,479 DEBUG [RS:0;jenkins-hbase4:46165] zookeeper.ReadOnlyZKClient(139): Connect 0x4e78efa8 to 127.0.0.1:60609 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:21,487 DEBUG [RS:0;jenkins-hbase4:46165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40bf1817, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:21,487 DEBUG [RS:1;jenkins-hbase4:43151] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ff056fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:21,487 DEBUG [RS:0;jenkins-hbase4:46165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@448084d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:21,488 DEBUG [RS:1;jenkins-hbase4:43151] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bcfdfd8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:21,501 DEBUG [RS:0;jenkins-hbase4:46165] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46165 2023-02-19 21:00:21,501 DEBUG [RS:1;jenkins-hbase4:43151] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43151 2023-02-19 21:00:21,502 INFO [RS:0;jenkins-hbase4:46165] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 21:00:21,502 INFO [RS:0;jenkins-hbase4:46165] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 21:00:21,502 INFO [RS:1;jenkins-hbase4:43151] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 21:00:21,502 INFO [RS:1;jenkins-hbase4:43151] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 21:00:21,502 DEBUG [RS:0;jenkins-hbase4:46165] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 21:00:21,502 DEBUG [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 21:00:21,502 INFO [RS:0;jenkins-hbase4:46165] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38069,1676840421164 with isa=jenkins-hbase4.apache.org/172.31.14.131:46165, startcode=1676840421216 2023-02-19 21:00:21,502 INFO [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38069,1676840421164 with isa=jenkins-hbase4.apache.org/172.31.14.131:43151, startcode=1676840421245 2023-02-19 21:00:21,503 DEBUG [RS:1;jenkins-hbase4:43151] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 21:00:21,503 DEBUG [RS:0;jenkins-hbase4:46165] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 21:00:21,506 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35497, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 21:00:21,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:21,508 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36285, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 21:00:21,508 DEBUG [RS:0;jenkins-hbase4:46165] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64 2023-02-19 21:00:21,508 DEBUG [RS:0;jenkins-hbase4:46165] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40483 2023-02-19 21:00:21,508 DEBUG [RS:0;jenkins-hbase4:46165] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 21:00:21,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:21,508 DEBUG [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64 2023-02-19 21:00:21,508 DEBUG [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40483 2023-02-19 21:00:21,508 DEBUG [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 21:00:21,511 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:21,515 DEBUG [RS:0;jenkins-hbase4:46165] zookeeper.ZKUtil(162): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:21,515 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43151,1676840421245] 2023-02-19 21:00:21,515 WARN [RS:0;jenkins-hbase4:46165] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:21,515 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46165,1676840421216] 2023-02-19 21:00:21,515 INFO [RS:0;jenkins-hbase4:46165] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:21,515 DEBUG [RS:1;jenkins-hbase4:43151] zookeeper.ZKUtil(162): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:21,515 DEBUG [RS:0;jenkins-hbase4:46165] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/WALs/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:21,515 WARN [RS:1;jenkins-hbase4:43151] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:21,515 INFO [RS:1;jenkins-hbase4:43151] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:21,515 DEBUG [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/WALs/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:21,519 DEBUG [RS:1;jenkins-hbase4:43151] zookeeper.ZKUtil(162): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:21,520 DEBUG [RS:0;jenkins-hbase4:46165] zookeeper.ZKUtil(162): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:21,520 DEBUG [RS:1;jenkins-hbase4:43151] zookeeper.ZKUtil(162): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:21,520 DEBUG [RS:0;jenkins-hbase4:46165] zookeeper.ZKUtil(162): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:21,521 DEBUG [RS:1;jenkins-hbase4:43151] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 21:00:21,521 DEBUG [RS:0;jenkins-hbase4:46165] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 21:00:21,521 INFO [RS:1;jenkins-hbase4:43151] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 21:00:21,521 INFO [RS:0;jenkins-hbase4:46165] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 21:00:21,522 INFO [RS:1;jenkins-hbase4:43151] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 21:00:21,523 INFO [RS:1;jenkins-hbase4:43151] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 21:00:21,523 INFO [RS:1;jenkins-hbase4:43151] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,523 INFO [RS:0;jenkins-hbase4:46165] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 21:00:21,523 INFO [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 21:00:21,524 INFO [RS:0;jenkins-hbase4:46165] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 21:00:21,524 INFO [RS:0;jenkins-hbase4:46165] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,524 INFO [RS:0;jenkins-hbase4:46165] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 21:00:21,525 INFO [RS:1;jenkins-hbase4:43151] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,525 DEBUG [RS:1;jenkins-hbase4:43151] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,525 DEBUG [RS:1;jenkins-hbase4:43151] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,525 DEBUG [RS:1;jenkins-hbase4:43151] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,525 INFO [RS:0;jenkins-hbase4:46165] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,525 DEBUG [RS:1;jenkins-hbase4:43151] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:0;jenkins-hbase4:46165] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:1;jenkins-hbase4:43151] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:0;jenkins-hbase4:46165] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:1;jenkins-hbase4:43151] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:21,526 DEBUG [RS:0;jenkins-hbase4:46165] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:1;jenkins-hbase4:43151] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:0;jenkins-hbase4:46165] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:1;jenkins-hbase4:43151] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:0;jenkins-hbase4:46165] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:1;jenkins-hbase4:43151] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:0;jenkins-hbase4:46165] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:21,526 DEBUG [RS:1;jenkins-hbase4:43151] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:0;jenkins-hbase4:46165] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:0;jenkins-hbase4:46165] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:0;jenkins-hbase4:46165] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,526 DEBUG [RS:0;jenkins-hbase4:46165] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:21,528 INFO [RS:1;jenkins-hbase4:43151] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,528 INFO [RS:1;jenkins-hbase4:43151] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,529 INFO [RS:1;jenkins-hbase4:43151] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,529 INFO [RS:0;jenkins-hbase4:46165] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,529 INFO [RS:0;jenkins-hbase4:46165] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,529 INFO [RS:0;jenkins-hbase4:46165] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,540 INFO [RS:1;jenkins-hbase4:43151] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 21:00:21,540 INFO [RS:1;jenkins-hbase4:43151] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43151,1676840421245-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,540 INFO [RS:0;jenkins-hbase4:46165] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 21:00:21,540 INFO [RS:0;jenkins-hbase4:46165] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46165,1676840421216-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:21,550 INFO [RS:1;jenkins-hbase4:43151] regionserver.Replication(203): jenkins-hbase4.apache.org,43151,1676840421245 started 2023-02-19 21:00:21,550 INFO [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43151,1676840421245, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43151, sessionid=0x1006e6230cb0002 2023-02-19 21:00:21,550 DEBUG [RS:1;jenkins-hbase4:43151] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 21:00:21,550 DEBUG [RS:1;jenkins-hbase4:43151] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:21,550 DEBUG [RS:1;jenkins-hbase4:43151] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43151,1676840421245' 2023-02-19 21:00:21,550 INFO [RS:0;jenkins-hbase4:46165] regionserver.Replication(203): jenkins-hbase4.apache.org,46165,1676840421216 started 2023-02-19 21:00:21,550 DEBUG [RS:1;jenkins-hbase4:43151] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:21,550 INFO [RS:0;jenkins-hbase4:46165] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46165,1676840421216, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46165, sessionid=0x1006e6230cb0001 2023-02-19 21:00:21,551 DEBUG [RS:0;jenkins-hbase4:46165] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 21:00:21,551 DEBUG [RS:0;jenkins-hbase4:46165] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:21,551 DEBUG [RS:0;jenkins-hbase4:46165] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46165,1676840421216' 2023-02-19 21:00:21,551 DEBUG [RS:0;jenkins-hbase4:46165] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:21,551 DEBUG [RS:1;jenkins-hbase4:43151] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:21,551 DEBUG [RS:0;jenkins-hbase4:46165] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:21,551 DEBUG [RS:1;jenkins-hbase4:43151] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 21:00:21,551 DEBUG [RS:1;jenkins-hbase4:43151] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 21:00:21,551 DEBUG [RS:1;jenkins-hbase4:43151] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:21,551 DEBUG [RS:1;jenkins-hbase4:43151] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43151,1676840421245' 2023-02-19 21:00:21,551 DEBUG [RS:1;jenkins-hbase4:43151] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:21,551 DEBUG [RS:0;jenkins-hbase4:46165] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 21:00:21,551 DEBUG [RS:0;jenkins-hbase4:46165] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 21:00:21,551 DEBUG [RS:0;jenkins-hbase4:46165] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:21,551 DEBUG [RS:0;jenkins-hbase4:46165] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46165,1676840421216' 2023-02-19 21:00:21,552 DEBUG [RS:1;jenkins-hbase4:43151] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:21,552 DEBUG [RS:0;jenkins-hbase4:46165] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:21,552 DEBUG [RS:1;jenkins-hbase4:43151] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 21:00:21,552 INFO [RS:1;jenkins-hbase4:43151] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 21:00:21,552 DEBUG [RS:0;jenkins-hbase4:46165] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:21,552 INFO [RS:1;jenkins-hbase4:43151] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 21:00:21,552 DEBUG [RS:0;jenkins-hbase4:46165] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 21:00:21,552 INFO [RS:0;jenkins-hbase4:46165] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 21:00:21,552 INFO [RS:0;jenkins-hbase4:46165] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 21:00:21,860 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:21,862 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 21:00:21,863 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/info 2023-02-19 21:00:21,864 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 21:00:21,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:21,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 21:00:21,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:21,866 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 21:00:21,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:21,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 21:00:21,868 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/table 2023-02-19 21:00:21,868 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 21:00:21,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:21,869 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740 2023-02-19 21:00:21,869 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740 2023-02-19 21:00:21,871 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 21:00:21,872 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 21:00:21,874 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:21,874 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72867119, jitterRate=0.08580468595027924}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 21:00:21,874 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 21:00:21,874 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:21,874 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:21,874 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:21,874 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:21,875 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:21,875 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:21,875 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:21,875 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:21,875 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 21:00:21,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 21:00:21,877 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 21:00:21,880 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 21:00:21,961 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 21:00:22,030 DEBUG [jenkins-hbase4:38069] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 21:00:22,031 DEBUG [jenkins-hbase4:38069] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:22,032 DEBUG [jenkins-hbase4:38069] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:22,032 DEBUG [jenkins-hbase4:38069] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:22,032 DEBUG [jenkins-hbase4:38069] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:22,033 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43151,1676840421245, state=OPENING 2023-02-19 21:00:22,034 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 21:00:22,037 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:22,037 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 21:00:22,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43151,1676840421245}] 2023-02-19 21:00:22,191 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:22,191 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 21:00:22,193 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33084, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 21:00:22,198 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 21:00:22,198 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:22,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43151%2C1676840421245.meta, suffix=.meta, logDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/WALs/jenkins-hbase4.apache.org,43151,1676840421245, archiveDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/oldWALs, maxLogs=32 2023-02-19 21:00:22,229 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39949,DS-d6f018ac-707a-4db3-b7ba-c8e38ca3e9e0,DISK] 2023-02-19 21:00:22,229 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33627,DS-5df8614a-b91c-4ab6-9f24-0876ed52e4e3,DISK] 2023-02-19 21:00:22,232 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/WALs/jenkins-hbase4.apache.org,43151,1676840421245/jenkins-hbase4.apache.org%2C43151%2C1676840421245.meta.1676840422201.meta 2023-02-19 21:00:22,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39949,DS-d6f018ac-707a-4db3-b7ba-c8e38ca3e9e0,DISK], DatanodeInfoWithStorage[127.0.0.1:33627,DS-5df8614a-b91c-4ab6-9f24-0876ed52e4e3,DISK]] 2023-02-19 21:00:22,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:22,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 21:00:22,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 21:00:22,233 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 21:00:22,234 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 21:00:22,234 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:22,234 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 21:00:22,234 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 21:00:22,235 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 21:00:22,236 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/info 2023-02-19 21:00:22,236 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/info 2023-02-19 21:00:22,236 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 21:00:22,237 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:22,237 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 21:00:22,238 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:22,238 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:22,238 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 21:00:22,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:22,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 21:00:22,240 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/table 2023-02-19 21:00:22,240 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/table 2023-02-19 21:00:22,240 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 21:00:22,241 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:22,242 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740 2023-02-19 21:00:22,243 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740 2023-02-19 21:00:22,245 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 21:00:22,246 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 21:00:22,247 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69998047, jitterRate=0.04305218160152435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 21:00:22,247 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 21:00:22,248 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676840422191 2023-02-19 21:00:22,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 21:00:22,252 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 21:00:22,252 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43151,1676840421245, state=OPEN 2023-02-19 21:00:22,254 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 21:00:22,254 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 21:00:22,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 21:00:22,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43151,1676840421245 in 217 msec 2023-02-19 21:00:22,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 21:00:22,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 379 msec 2023-02-19 21:00:22,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 824 msec 2023-02-19 21:00:22,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676840422258, completionTime=-1 2023-02-19 21:00:22,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 21:00:22,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 21:00:22,262 DEBUG [hconnection-0xdf74605-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:22,264 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33098, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:22,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 21:00:22,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676840482265 2023-02-19 21:00:22,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676840542265 2023-02-19 21:00:22,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-19 21:00:22,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38069,1676840421164-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:22,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38069,1676840421164-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:22,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38069,1676840421164-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:22,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38069, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:22,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:22,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 21:00:22,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:22,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 21:00:22,276 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 21:00:22,276 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 21:00:22,277 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 21:00:22,278 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/hbase/namespace/589043e43a58a8cf806caa957e538109 2023-02-19 21:00:22,279 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/hbase/namespace/589043e43a58a8cf806caa957e538109 empty. 2023-02-19 21:00:22,279 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/hbase/namespace/589043e43a58a8cf806caa957e538109 2023-02-19 21:00:22,279 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 21:00:22,289 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:22,290 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 589043e43a58a8cf806caa957e538109, NAME => 'hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp 2023-02-19 21:00:22,297 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:22,297 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 589043e43a58a8cf806caa957e538109, disabling compactions & flushes 2023-02-19 21:00:22,297 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. 2023-02-19 21:00:22,297 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. 2023-02-19 21:00:22,297 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. after waiting 0 ms 2023-02-19 21:00:22,297 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. 2023-02-19 21:00:22,298 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. 2023-02-19 21:00:22,298 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 589043e43a58a8cf806caa957e538109: 2023-02-19 21:00:22,299 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 21:00:22,300 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840422300"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840422300"}]},"ts":"1676840422300"} 2023-02-19 21:00:22,302 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 21:00:22,303 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 21:00:22,303 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840422303"}]},"ts":"1676840422303"} 2023-02-19 21:00:22,304 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 21:00:22,308 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:22,309 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:22,309 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:22,309 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:22,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=589043e43a58a8cf806caa957e538109, ASSIGN}] 2023-02-19 21:00:22,311 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=589043e43a58a8cf806caa957e538109, ASSIGN 2023-02-19 21:00:22,312 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=589043e43a58a8cf806caa957e538109, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43151,1676840421245; forceNewPlan=false, retain=false 2023-02-19 21:00:22,462 INFO [jenkins-hbase4:38069] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 21:00:22,463 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=589043e43a58a8cf806caa957e538109, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:22,463 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840422463"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840422463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840422463"}]},"ts":"1676840422463"} 2023-02-19 21:00:22,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 589043e43a58a8cf806caa957e538109, server=jenkins-hbase4.apache.org,43151,1676840421245}] 2023-02-19 21:00:22,554 INFO [RS:0;jenkins-hbase4:46165] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46165%2C1676840421216, suffix=, logDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/WALs/jenkins-hbase4.apache.org,46165,1676840421216, archiveDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/oldWALs, maxLogs=32 2023-02-19 21:00:22,554 INFO [RS:1;jenkins-hbase4:43151] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43151%2C1676840421245, suffix=, logDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/WALs/jenkins-hbase4.apache.org,43151,1676840421245, archiveDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/oldWALs, maxLogs=32 2023-02-19 21:00:22,573 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39949,DS-d6f018ac-707a-4db3-b7ba-c8e38ca3e9e0,DISK] 2023-02-19 21:00:22,575 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33627,DS-5df8614a-b91c-4ab6-9f24-0876ed52e4e3,DISK] 2023-02-19 21:00:22,575 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33627,DS-5df8614a-b91c-4ab6-9f24-0876ed52e4e3,DISK] 2023-02-19 21:00:22,575 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39949,DS-d6f018ac-707a-4db3-b7ba-c8e38ca3e9e0,DISK] 2023-02-19 21:00:22,577 INFO [RS:0;jenkins-hbase4:46165] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/WALs/jenkins-hbase4.apache.org,46165,1676840421216/jenkins-hbase4.apache.org%2C46165%2C1676840421216.1676840422558 2023-02-19 21:00:22,577 DEBUG [RS:0;jenkins-hbase4:46165] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33627,DS-5df8614a-b91c-4ab6-9f24-0876ed52e4e3,DISK], DatanodeInfoWithStorage[127.0.0.1:39949,DS-d6f018ac-707a-4db3-b7ba-c8e38ca3e9e0,DISK]] 2023-02-19 21:00:22,580 INFO [RS:1;jenkins-hbase4:43151] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/WALs/jenkins-hbase4.apache.org,43151,1676840421245/jenkins-hbase4.apache.org%2C43151%2C1676840421245.1676840422558 2023-02-19 21:00:22,580 DEBUG [RS:1;jenkins-hbase4:43151] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33627,DS-5df8614a-b91c-4ab6-9f24-0876ed52e4e3,DISK], DatanodeInfoWithStorage[127.0.0.1:39949,DS-d6f018ac-707a-4db3-b7ba-c8e38ca3e9e0,DISK]] 2023-02-19 21:00:22,620 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. 2023-02-19 21:00:22,620 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 589043e43a58a8cf806caa957e538109, NAME => 'hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:22,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 589043e43a58a8cf806caa957e538109 2023-02-19 21:00:22,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:22,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 589043e43a58a8cf806caa957e538109 2023-02-19 21:00:22,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 589043e43a58a8cf806caa957e538109 2023-02-19 21:00:22,622 INFO [StoreOpener-589043e43a58a8cf806caa957e538109-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 589043e43a58a8cf806caa957e538109 2023-02-19 21:00:22,624 DEBUG [StoreOpener-589043e43a58a8cf806caa957e538109-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/namespace/589043e43a58a8cf806caa957e538109/info 2023-02-19 21:00:22,624 DEBUG [StoreOpener-589043e43a58a8cf806caa957e538109-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/namespace/589043e43a58a8cf806caa957e538109/info 2023-02-19 21:00:22,624 INFO [StoreOpener-589043e43a58a8cf806caa957e538109-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 589043e43a58a8cf806caa957e538109 columnFamilyName info 2023-02-19 21:00:22,625 INFO [StoreOpener-589043e43a58a8cf806caa957e538109-1] regionserver.HStore(310): Store=589043e43a58a8cf806caa957e538109/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:22,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/namespace/589043e43a58a8cf806caa957e538109 2023-02-19 21:00:22,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/namespace/589043e43a58a8cf806caa957e538109 2023-02-19 21:00:22,629 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 589043e43a58a8cf806caa957e538109 2023-02-19 21:00:22,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/namespace/589043e43a58a8cf806caa957e538109/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:22,632 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 589043e43a58a8cf806caa957e538109; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59067764, jitterRate=-0.11982172727584839}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 21:00:22,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 589043e43a58a8cf806caa957e538109: 2023-02-19 21:00:22,632 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109., pid=6, masterSystemTime=1676840422617 2023-02-19 21:00:22,634 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. 2023-02-19 21:00:22,634 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. 2023-02-19 21:00:22,634 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=589043e43a58a8cf806caa957e538109, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:22,635 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840422634"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840422634"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840422634"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840422634"}]},"ts":"1676840422634"} 2023-02-19 21:00:22,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 21:00:22,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 589043e43a58a8cf806caa957e538109, server=jenkins-hbase4.apache.org,43151,1676840421245 in 171 msec 2023-02-19 21:00:22,639 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 21:00:22,639 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=589043e43a58a8cf806caa957e538109, ASSIGN in 329 msec 2023-02-19 21:00:22,640 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 21:00:22,640 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840422640"}]},"ts":"1676840422640"} 2023-02-19 21:00:22,641 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 21:00:22,644 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 21:00:22,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 370 msec 2023-02-19 21:00:22,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 21:00:22,677 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:22,677 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:22,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 21:00:22,691 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:22,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-19 21:00:22,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 21:00:22,711 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:22,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-19 21:00:22,729 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 21:00:22,732 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 21:00:22,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.461sec 2023-02-19 21:00:22,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 21:00:22,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 21:00:22,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 21:00:22,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38069,1676840421164-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 21:00:22,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38069,1676840421164-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 21:00:22,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 21:00:22,767 DEBUG [Listener at localhost/46375] zookeeper.ReadOnlyZKClient(139): Connect 0x17f9e268 to 127.0.0.1:60609 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:22,774 DEBUG [Listener at localhost/46375] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e4c5735, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:22,776 DEBUG [hconnection-0x11acda89-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:22,779 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33100, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:22,781 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38069,1676840421164 2023-02-19 21:00:22,781 DEBUG [Listener at localhost/46375] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 21:00:22,783 DEBUG [Listener at localhost/46375] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 21:00:22,786 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41892, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 21:00:22,786 INFO [Listener at localhost/46375] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:22,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:22,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 21:00:22,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:41892 deadline: 1676840482787, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:22,788 INFO [Listener at localhost/46375] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-19 21:00:22,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:22,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:22,793 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 21:00:22,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-19 21:00:22,794 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 21:00:22,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:22,796 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:22,796 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a empty. 2023-02-19 21:00:22,797 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:22,797 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-19 21:00:22,809 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:22,810 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 75453d386b9f8108e8e9405f42df084a, NAME => 'testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp 2023-02-19 21:00:22,817 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:22,817 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 75453d386b9f8108e8e9405f42df084a, disabling compactions & flushes 2023-02-19 21:00:22,818 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:22,818 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:22,818 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. after waiting 0 ms 2023-02-19 21:00:22,818 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:22,818 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:22,818 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 75453d386b9f8108e8e9405f42df084a: 2023-02-19 21:00:22,820 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 21:00:22,821 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676840422820"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840422820"}]},"ts":"1676840422820"} 2023-02-19 21:00:22,822 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 21:00:22,823 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 21:00:22,823 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840422823"}]},"ts":"1676840422823"} 2023-02-19 21:00:22,824 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-19 21:00:22,827 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:22,828 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:22,828 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:22,828 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:22,828 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=75453d386b9f8108e8e9405f42df084a, ASSIGN}] 2023-02-19 21:00:22,830 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=75453d386b9f8108e8e9405f42df084a, ASSIGN 2023-02-19 21:00:22,831 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=75453d386b9f8108e8e9405f42df084a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43151,1676840421245; forceNewPlan=false, retain=false 2023-02-19 21:00:22,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:22,981 INFO [jenkins-hbase4:38069] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 21:00:22,982 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=75453d386b9f8108e8e9405f42df084a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:22,982 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676840422982"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840422982"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840422982"}]},"ts":"1676840422982"} 2023-02-19 21:00:22,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 75453d386b9f8108e8e9405f42df084a, server=jenkins-hbase4.apache.org,43151,1676840421245}] 2023-02-19 21:00:23,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:23,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:23,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 75453d386b9f8108e8e9405f42df084a, NAME => 'testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:23,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:23,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:23,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:23,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:23,144 INFO [StoreOpener-75453d386b9f8108e8e9405f42df084a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:23,146 DEBUG [StoreOpener-75453d386b9f8108e8e9405f42df084a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1 2023-02-19 21:00:23,146 DEBUG [StoreOpener-75453d386b9f8108e8e9405f42df084a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1 2023-02-19 21:00:23,146 INFO [StoreOpener-75453d386b9f8108e8e9405f42df084a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75453d386b9f8108e8e9405f42df084a columnFamilyName f1 2023-02-19 21:00:23,147 INFO [StoreOpener-75453d386b9f8108e8e9405f42df084a-1] regionserver.HStore(310): Store=75453d386b9f8108e8e9405f42df084a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:23,147 INFO [StoreOpener-75453d386b9f8108e8e9405f42df084a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:23,148 DEBUG [StoreOpener-75453d386b9f8108e8e9405f42df084a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2 2023-02-19 21:00:23,148 DEBUG [StoreOpener-75453d386b9f8108e8e9405f42df084a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2 2023-02-19 21:00:23,149 INFO [StoreOpener-75453d386b9f8108e8e9405f42df084a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75453d386b9f8108e8e9405f42df084a columnFamilyName f2 2023-02-19 21:00:23,149 INFO [StoreOpener-75453d386b9f8108e8e9405f42df084a-1] regionserver.HStore(310): Store=75453d386b9f8108e8e9405f42df084a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:23,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:23,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:23,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:23,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:23,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:23,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 75453d386b9f8108e8e9405f42df084a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63432409, jitterRate=-0.054783448576927185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:23,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 75453d386b9f8108e8e9405f42df084a: 2023-02-19 21:00:23,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a., pid=12, masterSystemTime=1676840423136 2023-02-19 21:00:23,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:23,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:23,161 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=75453d386b9f8108e8e9405f42df084a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,161 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676840423161"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840423161"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840423161"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840423161"}]},"ts":"1676840423161"} 2023-02-19 21:00:23,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-19 21:00:23,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 75453d386b9f8108e8e9405f42df084a, server=jenkins-hbase4.apache.org,43151,1676840421245 in 180 msec 2023-02-19 21:00:23,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-19 21:00:23,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=75453d386b9f8108e8e9405f42df084a, ASSIGN in 338 msec 2023-02-19 21:00:23,169 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 21:00:23,169 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840423169"}]},"ts":"1676840423169"} 2023-02-19 21:00:23,171 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-19 21:00:23,174 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 21:00:23,175 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 384 msec 2023-02-19 21:00:23,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:23,399 INFO [Listener at localhost/46375] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-19 21:00:23,399 DEBUG [Listener at localhost/46375] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-19 21:00:23,400 INFO [Listener at localhost/46375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 21:00:23,402 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-19 21:00:23,402 INFO [Listener at localhost/46375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 21:00:23,402 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-19 21:00:23,402 INFO [Listener at localhost/46375] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 21:00:23,442 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43151] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:23,542 INFO [Listener at localhost/46375] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 21:00:23,543 INFO [Listener at localhost/46375] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 21:00:23,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-19 21:00:23,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676840423544 (current time:1676840423544). 2023-02-19 21:00:23,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 21:00:23,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x0fe016ef to 127.0.0.1:60609 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:23,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46ea0e69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:23,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:23,553 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49956, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:23,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fe016ef to 127.0.0.1:60609 2023-02-19 21:00:23,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:23,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 21:00:23,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-19 21:00:23,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-19 21:00:23,557 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-19 21:00:23,558 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676841023558 2023-02-19 21:00:23,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-19 21:00:23,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:23,559 DEBUG [Listener at localhost/46375] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:23,559 DEBUG [Listener at localhost/46375] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 21:00:23,560 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-19 21:00:23,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-19 21:00:23,561 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-19 21:00:23,562 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-19 21:00:23,562 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676841023562 2023-02-19 21:00:23,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-19 21:00:23,572 INFO [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-19 21:00:23,572 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:23,573 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-19 21:00:23,573 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-19 21:00:23,573 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,573 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-19 21:00:23,574 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,574 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:23,574 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:23,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:23,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:23,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:23,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:23,575 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,575 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:23,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-19 21:00:23,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-19 21:00:23,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-19 21:00:23,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-19 21:00:23,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-19 21:00:23,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-19 21:00:23,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-19 21:00:23,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-19 21:00:23,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-19 21:00:23,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-19 21:00:23,576 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-19 21:00:23,576 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:23,577 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-19 21:00:23,577 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-19 21:00:23,577 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-19 21:00:23,577 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43151,1676840421245' joining acquired barrier for procedure (foo) in zk 2023-02-19 21:00:23,577 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:23,577 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-19 21:00:23,577 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-19 21:00:23,577 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46165,1676840421216' joining acquired barrier for procedure (foo) in zk 2023-02-19 21:00:23,579 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,579 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:23,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:23,580 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:23,580 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,580 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:23,580 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,581 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 21:00:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:23,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43151,1676840421245' joining acquired barrier for procedure 'foo' on coordinator 2023-02-19 21:00:23,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f5b278e[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:23,582 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-19 21:00:23,582 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,583 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,583 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-19 21:00:23,583 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,583 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:23,583 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-19 21:00:23,583 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 21:00:23,583 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:23,583 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,583 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. started... 2023-02-19 21:00:23,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,584 INFO [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 75453d386b9f8108e8e9405f42df084a 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-19 21:00:23,584 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-19 21:00:23,584 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-19 21:00:23,584 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,46165,1676840421216' in zk 2023-02-19 21:00:23,586 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-19 21:00:23,586 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:23,586 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-19 21:00:23,604 INFO [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/.tmp/f1/20d3f53b47c24081a199785203088c70 2023-02-19 21:00:23,622 INFO [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/.tmp/f2/5c14b7aefcae41fcb146083884a90389 2023-02-19 21:00:23,627 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/.tmp/f1/20d3f53b47c24081a199785203088c70 as hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1/20d3f53b47c24081a199785203088c70 2023-02-19 21:00:23,631 INFO [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1/20d3f53b47c24081a199785203088c70, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 21:00:23,632 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/.tmp/f2/5c14b7aefcae41fcb146083884a90389 as hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2/5c14b7aefcae41fcb146083884a90389 2023-02-19 21:00:23,637 INFO [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2/5c14b7aefcae41fcb146083884a90389, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 21:00:23,638 INFO [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 75453d386b9f8108e8e9405f42df084a in 54ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:23,638 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-19 21:00:23,638 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 75453d386b9f8108e8e9405f42df084a: 2023-02-19 21:00:23,638 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.' region-info for snapshot=foo 2023-02-19 21:00:23,638 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:23,638 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1/20d3f53b47c24081a199785203088c70] hfiles 2023-02-19 21:00:23,638 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1/20d3f53b47c24081a199785203088c70 for snapshot=foo 2023-02-19 21:00:23,638 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2/5c14b7aefcae41fcb146083884a90389] hfiles 2023-02-19 21:00:23,638 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2/5c14b7aefcae41fcb146083884a90389 for snapshot=foo 2023-02-19 21:00:23,644 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. completed. 2023-02-19 21:00:23,644 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:23,644 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-19 21:00:23,644 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-19 21:00:23,644 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,644 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-19 21:00:23,644 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,43151,1676840421245' in zk 2023-02-19 21:00:23,646 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-19 21:00:23,646 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,646 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:23,646 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-19 21:00:23,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:23,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:23,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:23,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:23,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 21:00:23,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 21:00:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:23,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,43151,1676840421245': 2023-02-19 21:00:23,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43151,1676840421245' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-19 21:00:23,650 INFO [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-19 21:00:23,650 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:23,650 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:23,650 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-19 21:00:23,650 INFO [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 21:00:23,653 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,653 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,653 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,653 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:23,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:23,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:23,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,653 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:23,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:23,654 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:23,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 21:00:23,654 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:23,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:23,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:23,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:23,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:23,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 21:00:23,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:23,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:23,657 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 21:00:23,657 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:23,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:23,660 DEBUG [Listener at localhost/46375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:23,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-19 21:00:23,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-19 21:00:23,662 DEBUG [Listener at localhost/46375] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 21:00:23,663 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:23,663 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-19 21:00:23,663 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:23,663 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:23,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:23,663 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:23,663 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:23,663 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-19 21:00:23,663 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-19 21:00:23,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-19 21:00:23,663 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:23,664 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:23,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:23,664 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,664 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:23,664 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:23,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:23,665 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 21:00:23,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:23,665 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 21:00:23,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:23,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:23,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.hbase-snapshot/.tmp/foo 2023-02-19 21:00:23,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.hbase-snapshot/.tmp/foo to hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.hbase-snapshot/foo 2023-02-19 21:00:23,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-19 21:00:23,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.hbase-snapshot/.tmp/foo 2023-02-19 21:00:23,696 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.hbase-snapshot/.tmp/foo 2023-02-19 21:00:23,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676840423558Consolidate snapshot: foo at 1676840423664 (+106 ms)Loading Region manifests for foo at 1676840423664Writing data manifest for foo at 1676840423668 (+4 ms)Verifying snapshot: foo at 1676840423674 (+6 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676840423695 (+21 ms) 2023-02-19 21:00:23,699 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-19 21:00:23,701 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 140 msec 2023-02-19 21:00:23,862 DEBUG [Listener at localhost/46375] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:23,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-19 21:00:23,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 21:00:23,864 INFO [Listener at localhost/46375] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 21:00:23,868 INFO [Listener at localhost/46375] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 21:00:23,873 INFO [Listener at localhost/46375] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 21:00:23,912 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43151] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:24,066 INFO [Listener at localhost/46375] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 21:00:24,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 21:00:24,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,075 INFO [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-19 21:00:24,075 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:24,075 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-19 21:00:24,076 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-19 21:00:24,076 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,076 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,078 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,078 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:24,078 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:24,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:24,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:24,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:24,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:24,078 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,078 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:24,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:24,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:24,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,080 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-19 21:00:24,080 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:24,080 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-19 21:00:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-19 21:00:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-19 21:00:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-19 21:00:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46165,1676840421216' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-19 21:00:24,083 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,083 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,083 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:24,084 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-19 21:00:24,084 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 21:00:24,084 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:24,084 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. started... 2023-02-19 21:00:24,084 INFO [rs(jenkins-hbase4.apache.org,43151,1676840421245)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 75453d386b9f8108e8e9405f42df084a 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-19 21:00:24,105 INFO [rs(jenkins-hbase4.apache.org,43151,1676840421245)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/.tmp/f1/a48ec9ec7a7f417b850dadbdfe8ad853 2023-02-19 21:00:24,129 INFO [rs(jenkins-hbase4.apache.org,43151,1676840421245)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/.tmp/f2/2772a4e05e9c40989e3919a1b17b65b6 2023-02-19 21:00:24,134 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/.tmp/f1/a48ec9ec7a7f417b850dadbdfe8ad853 as hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1/a48ec9ec7a7f417b850dadbdfe8ad853 2023-02-19 21:00:24,138 INFO [rs(jenkins-hbase4.apache.org,43151,1676840421245)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1/a48ec9ec7a7f417b850dadbdfe8ad853, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 21:00:24,139 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/.tmp/f2/2772a4e05e9c40989e3919a1b17b65b6 as hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2/2772a4e05e9c40989e3919a1b17b65b6 2023-02-19 21:00:24,144 INFO [rs(jenkins-hbase4.apache.org,43151,1676840421245)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2/2772a4e05e9c40989e3919a1b17b65b6, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 21:00:24,145 INFO [rs(jenkins-hbase4.apache.org,43151,1676840421245)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 75453d386b9f8108e8e9405f42df084a in 61ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:24,146 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 75453d386b9f8108e8e9405f42df084a: 2023-02-19 21:00:24,146 DEBUG [rs(jenkins-hbase4.apache.org,43151,1676840421245)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:24,146 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-19 21:00:24,146 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-19 21:00:24,146 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,146 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-19 21:00:24,147 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43151,1676840421245' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-19 21:00:24,150 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,150 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:24,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:24,150 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,150 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:24,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:24,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:24,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:24,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:24,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43151,1676840421245' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-19 21:00:24,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b64b8bd[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:24,152 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-19 21:00:24,152 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,154 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,154 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,154 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-19 21:00:24,154 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-19 21:00:24,154 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,154 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:24,154 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-19 21:00:24,154 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-19 21:00:24,154 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,46165,1676840421216' in zk 2023-02-19 21:00:24,154 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,43151,1676840421245' in zk 2023-02-19 21:00:24,156 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-19 21:00:24,156 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:24,156 DEBUG [member: 'jenkins-hbase4.apache.org,46165,1676840421216' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-19 21:00:24,157 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,157 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-19 21:00:24,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:24,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:24,157 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:24,158 DEBUG [member: 'jenkins-hbase4.apache.org,43151,1676840421245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-19 21:00:24,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:24,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:24,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:24,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:24,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:24,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,43151,1676840421245': 2023-02-19 21:00:24,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43151,1676840421245' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-19 21:00:24,165 INFO [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-19 21:00:24,165 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:24,165 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:24,165 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,165 INFO [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 21:00:24,168 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:24,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:24,168 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,169 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,169 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:24,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:24,169 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:24,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:24,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:24,170 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:24,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:24,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,170 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:24,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:24,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:24,172 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:24,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,172 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:24,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:24,175 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:24,175 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:24,175 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:24,175 DEBUG [(jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:24,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-19 21:00:24,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 21:00:24,175 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:24,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:24,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:24,175 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:24,175 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,177 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,177 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,177 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:24,177 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,177 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,177 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,177 DEBUG [Listener at localhost/46375] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:24,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:24,177 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:24,177 DEBUG [Listener at localhost/46375] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 21:00:24,278 DEBUG [Listener at localhost/46375] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 21:00:24,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 21:00:24,284 INFO [Listener at localhost/46375] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676840423544 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:24,284 DEBUG [Listener at localhost/46375] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40483/user/jenkins/test-data/38bdb3a7-5374-f9a2-2e70-da0089e63942/foo/639110de-b512-49df-9cd0-c8fd518e0baa/data/default/testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,284 INFO [Listener at localhost/46375] snapshot.RestoreSnapshotHelper(239): region to add: 75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:24,284 INFO [Listener at localhost/46375] snapshot.RestoreSnapshotHelper(585): clone region=75453d386b9f8108e8e9405f42df084a as 75453d386b9f8108e8e9405f42df084a in snapshot foo 2023-02-19 21:00:24,285 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 75453d386b9f8108e8e9405f42df084a, NAME => 'testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40483/user/jenkins/test-data/38bdb3a7-5374-f9a2-2e70-da0089e63942/foo/639110de-b512-49df-9cd0-c8fd518e0baa 2023-02-19 21:00:24,292 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:24,292 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 20d3f53b47c24081a199785203088c70 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,294 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5c14b7aefcae41fcb146083884a90389 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,296 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 75453d386b9f8108e8e9405f42df084a, disabling compactions & flushes 2023-02-19 21:00:24,296 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:24,296 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:24,296 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. after waiting 0 ms 2023-02-19 21:00:24,296 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:24,296 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:24,296 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 75453d386b9f8108e8e9405f42df084a: 2023-02-19 21:00:24,297 INFO [Listener at localhost/46375] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676840423544 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:24,297 DEBUG [Listener at localhost/46375] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40483/user/jenkins/test-data/38bdb3a7-5374-f9a2-2e70-da0089e63942/foo/639110de-b512-49df-9cd0-c8fd518e0baa 2023-02-19 21:00:24,297 DEBUG [Listener at localhost/46375] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40483/user/jenkins/test-data/38bdb3a7-5374-f9a2-2e70-da0089e63942/foo/639110de-b512-49df-9cd0-c8fd518e0baa 2023-02-19 21:00:24,297 DEBUG [Listener at localhost/46375] util.CommonFSUtils(699): |-data/ 2023-02-19 21:00:24,298 DEBUG [Listener at localhost/46375] util.CommonFSUtils(699): |----default/ 2023-02-19 21:00:24,298 DEBUG [Listener at localhost/46375] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-19 21:00:24,299 DEBUG [Listener at localhost/46375] util.CommonFSUtils(699): |----------75453d386b9f8108e8e9405f42df084a/ 2023-02-19 21:00:24,299 DEBUG [Listener at localhost/46375] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:24,299 DEBUG [Listener at localhost/46375] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:24,300 DEBUG [Listener at localhost/46375] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=75453d386b9f8108e8e9405f42df084a-20d3f53b47c24081a199785203088c70 2023-02-19 21:00:24,300 DEBUG [Listener at localhost/46375] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:24,300 DEBUG [Listener at localhost/46375] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=75453d386b9f8108e8e9405f42df084a-5c14b7aefcae41fcb146083884a90389 2023-02-19 21:00:24,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-19 21:00:24,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-19 21:00:24,305 INFO [Listener at localhost/46375] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 21:00:24,308 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840424308"}]},"ts":"1676840424308"} 2023-02-19 21:00:24,310 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-19 21:00:24,311 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-19 21:00:24,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=75453d386b9f8108e8e9405f42df084a, UNASSIGN}] 2023-02-19 21:00:24,313 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=75453d386b9f8108e8e9405f42df084a, UNASSIGN 2023-02-19 21:00:24,314 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=75453d386b9f8108e8e9405f42df084a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,314 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676840424314"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840424314"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840424314"}]},"ts":"1676840424314"} 2023-02-19 21:00:24,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 75453d386b9f8108e8e9405f42df084a, server=jenkins-hbase4.apache.org,43151,1676840421245}] 2023-02-19 21:00:24,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 21:00:24,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:24,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 75453d386b9f8108e8e9405f42df084a, disabling compactions & flushes 2023-02-19 21:00:24,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:24,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:24,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. after waiting 0 ms 2023-02-19 21:00:24,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:24,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:24,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a. 2023-02-19 21:00:24,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 75453d386b9f8108e8e9405f42df084a: 2023-02-19 21:00:24,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:24,474 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=75453d386b9f8108e8e9405f42df084a, regionState=CLOSED 2023-02-19 21:00:24,474 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676840424473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840424473"}]},"ts":"1676840424473"} 2023-02-19 21:00:24,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-19 21:00:24,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 75453d386b9f8108e8e9405f42df084a, server=jenkins-hbase4.apache.org,43151,1676840421245 in 160 msec 2023-02-19 21:00:24,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-19 21:00:24,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=75453d386b9f8108e8e9405f42df084a, UNASSIGN in 164 msec 2023-02-19 21:00:24,478 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840424478"}]},"ts":"1676840424478"} 2023-02-19 21:00:24,479 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-19 21:00:24,481 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-19 21:00:24,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 176 msec 2023-02-19 21:00:24,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 21:00:24,612 INFO [Listener at localhost/46375] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-19 21:00:24,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,615 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,616 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 21:00:24,619 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:24,621 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1, FileablePath, hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2, FileablePath, hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/recovered.edits] 2023-02-19 21:00:24,626 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1/20d3f53b47c24081a199785203088c70 to hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/archive/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1/20d3f53b47c24081a199785203088c70 2023-02-19 21:00:24,627 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1/a48ec9ec7a7f417b850dadbdfe8ad853 to hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/archive/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f1/a48ec9ec7a7f417b850dadbdfe8ad853 2023-02-19 21:00:24,630 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2/2772a4e05e9c40989e3919a1b17b65b6 to hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/archive/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2/2772a4e05e9c40989e3919a1b17b65b6 2023-02-19 21:00:24,631 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2/5c14b7aefcae41fcb146083884a90389 to hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/archive/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/f2/5c14b7aefcae41fcb146083884a90389 2023-02-19 21:00:24,634 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/recovered.edits/12.seqid to hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/archive/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a/recovered.edits/12.seqid 2023-02-19 21:00:24,635 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/.tmp/data/default/testInitTableSnapshotMapperJobConfig/75453d386b9f8108e8e9405f42df084a 2023-02-19 21:00:24,635 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-19 21:00:24,637 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,639 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-19 21:00:24,642 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-19 21:00:24,643 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,643 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-19 21:00:24,643 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840424643"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:24,645 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-19 21:00:24,645 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 75453d386b9f8108e8e9405f42df084a, NAME => 'testInitTableSnapshotMapperJobConfig,,1676840422790.75453d386b9f8108e8e9405f42df084a.', STARTKEY => '', ENDKEY => ''}] 2023-02-19 21:00:24,645 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-19 21:00:24,645 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676840424645"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:24,649 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-19 21:00:24,652 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 21:00:24,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 39 msec 2023-02-19 21:00:24,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 21:00:24,718 INFO [Listener at localhost/46375] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-19 21:00:24,718 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 21:00:24,718 INFO [Listener at localhost/46375] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 21:00:24,719 DEBUG [Listener at localhost/46375] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17f9e268 to 127.0.0.1:60609 2023-02-19 21:00:24,719 DEBUG [Listener at localhost/46375] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:24,719 DEBUG [Listener at localhost/46375] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 21:00:24,719 DEBUG [Listener at localhost/46375] util.JVMClusterUtil(257): Found active master hash=1640013225, stopped=false 2023-02-19 21:00:24,719 INFO [Listener at localhost/46375] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38069,1676840421164 2023-02-19 21:00:24,721 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:24,721 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:24,721 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:24,721 INFO [Listener at localhost/46375] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 21:00:24,721 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:24,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:24,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:24,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:24,725 DEBUG [Listener at localhost/46375] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78702325 to 127.0.0.1:60609 2023-02-19 21:00:24,725 DEBUG [Listener at localhost/46375] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:24,725 INFO [Listener at localhost/46375] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46165,1676840421216' ***** 2023-02-19 21:00:24,725 INFO [Listener at localhost/46375] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:24,725 INFO [Listener at localhost/46375] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43151,1676840421245' ***** 2023-02-19 21:00:24,725 INFO [Listener at localhost/46375] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:24,725 INFO [RS:0;jenkins-hbase4:46165] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:24,725 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:24,725 INFO [RS:0;jenkins-hbase4:46165] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:24,725 INFO [RS:1;jenkins-hbase4:43151] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:24,726 INFO [RS:0;jenkins-hbase4:46165] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:24,726 INFO [RS:1;jenkins-hbase4:43151] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:24,726 INFO [RS:0;jenkins-hbase4:46165] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:24,726 INFO [RS:1;jenkins-hbase4:43151] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:24,727 DEBUG [RS:0;jenkins-hbase4:46165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e78efa8 to 127.0.0.1:60609 2023-02-19 21:00:24,727 INFO [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(3304): Received CLOSE for 589043e43a58a8cf806caa957e538109 2023-02-19 21:00:24,727 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:24,727 INFO [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,728 DEBUG [RS:1;jenkins-hbase4:43151] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6137b4a8 to 127.0.0.1:60609 2023-02-19 21:00:24,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 589043e43a58a8cf806caa957e538109, disabling compactions & flushes 2023-02-19 21:00:24,727 DEBUG [RS:0;jenkins-hbase4:46165] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:24,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. 2023-02-19 21:00:24,728 INFO [RS:0;jenkins-hbase4:46165] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46165,1676840421216; all regions closed. 2023-02-19 21:00:24,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. 2023-02-19 21:00:24,728 DEBUG [RS:1;jenkins-hbase4:43151] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:24,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. after waiting 0 ms 2023-02-19 21:00:24,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. 2023-02-19 21:00:24,729 INFO [RS:1;jenkins-hbase4:43151] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:24,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 589043e43a58a8cf806caa957e538109 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 21:00:24,729 INFO [RS:1;jenkins-hbase4:43151] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:24,729 INFO [RS:1;jenkins-hbase4:43151] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:24,729 INFO [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 21:00:24,729 INFO [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-19 21:00:24,729 DEBUG [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 589043e43a58a8cf806caa957e538109=hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109.} 2023-02-19 21:00:24,729 DEBUG [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(1505): Waiting on 1588230740, 589043e43a58a8cf806caa957e538109 2023-02-19 21:00:24,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:24,730 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:24,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:24,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:24,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:24,730 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-19 21:00:24,735 DEBUG [RS:0;jenkins-hbase4:46165] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/oldWALs 2023-02-19 21:00:24,736 INFO [RS:0;jenkins-hbase4:46165] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46165%2C1676840421216:(num 1676840422558) 2023-02-19 21:00:24,736 DEBUG [RS:0;jenkins-hbase4:46165] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:24,736 INFO [RS:0;jenkins-hbase4:46165] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:24,736 INFO [RS:0;jenkins-hbase4:46165] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:24,736 INFO [RS:0;jenkins-hbase4:46165] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:24,736 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:24,736 INFO [RS:0;jenkins-hbase4:46165] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:24,736 INFO [RS:0;jenkins-hbase4:46165] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:24,737 INFO [RS:0;jenkins-hbase4:46165] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46165 2023-02-19 21:00:24,739 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:24,739 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:24,739 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46165,1676840421216 2023-02-19 21:00:24,739 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:24,743 ERROR [Listener at localhost/46375-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@b9a53a0 rejected from java.util.concurrent.ThreadPoolExecutor@fa5c60b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:24,745 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:24,745 ERROR [Listener at localhost/46375-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@227903c1 rejected from java.util.concurrent.ThreadPoolExecutor@fa5c60b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:24,745 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46165,1676840421216] 2023-02-19 21:00:24,745 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46165,1676840421216; numProcessing=1 2023-02-19 21:00:24,746 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46165,1676840421216 already deleted, retry=false 2023-02-19 21:00:24,747 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46165,1676840421216 expired; onlineServers=1 2023-02-19 21:00:24,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/namespace/589043e43a58a8cf806caa957e538109/.tmp/info/2483ff3af4e545f689ed133693d40fdf 2023-02-19 21:00:24,754 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/.tmp/info/47fe52ffb32c4c068d3b8f8dc1d19859 2023-02-19 21:00:24,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/namespace/589043e43a58a8cf806caa957e538109/.tmp/info/2483ff3af4e545f689ed133693d40fdf as hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/namespace/589043e43a58a8cf806caa957e538109/info/2483ff3af4e545f689ed133693d40fdf 2023-02-19 21:00:24,758 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47fe52ffb32c4c068d3b8f8dc1d19859 2023-02-19 21:00:24,759 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:24,759 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:24,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/namespace/589043e43a58a8cf806caa957e538109/info/2483ff3af4e545f689ed133693d40fdf, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 21:00:24,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 589043e43a58a8cf806caa957e538109 in 34ms, sequenceid=6, compaction requested=false 2023-02-19 21:00:24,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/namespace/589043e43a58a8cf806caa957e538109/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 21:00:24,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. 2023-02-19 21:00:24,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 589043e43a58a8cf806caa957e538109: 2023-02-19 21:00:24,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676840422274.589043e43a58a8cf806caa957e538109. 2023-02-19 21:00:24,768 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/.tmp/rep_barrier/b78092adf58f4b5f88b3d3d0795d49b1 2023-02-19 21:00:24,772 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b78092adf58f4b5f88b3d3d0795d49b1 2023-02-19 21:00:24,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/.tmp/table/7db9ca7d57b6409cb4b935d82da8114c 2023-02-19 21:00:24,782 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7db9ca7d57b6409cb4b935d82da8114c 2023-02-19 21:00:24,782 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/.tmp/info/47fe52ffb32c4c068d3b8f8dc1d19859 as hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/info/47fe52ffb32c4c068d3b8f8dc1d19859 2023-02-19 21:00:24,786 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47fe52ffb32c4c068d3b8f8dc1d19859 2023-02-19 21:00:24,786 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/info/47fe52ffb32c4c068d3b8f8dc1d19859, entries=12, sequenceid=21, filesize=6.3 K 2023-02-19 21:00:24,787 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/.tmp/rep_barrier/b78092adf58f4b5f88b3d3d0795d49b1 as hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/rep_barrier/b78092adf58f4b5f88b3d3d0795d49b1 2023-02-19 21:00:24,791 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b78092adf58f4b5f88b3d3d0795d49b1 2023-02-19 21:00:24,791 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/rep_barrier/b78092adf58f4b5f88b3d3d0795d49b1, entries=1, sequenceid=21, filesize=5.0 K 2023-02-19 21:00:24,791 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/.tmp/table/7db9ca7d57b6409cb4b935d82da8114c as hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/table/7db9ca7d57b6409cb4b935d82da8114c 2023-02-19 21:00:24,795 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7db9ca7d57b6409cb4b935d82da8114c 2023-02-19 21:00:24,795 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/table/7db9ca7d57b6409cb4b935d82da8114c, entries=4, sequenceid=21, filesize=5.1 K 2023-02-19 21:00:24,795 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 65ms, sequenceid=21, compaction requested=false 2023-02-19 21:00:24,799 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-19 21:00:24,799 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 21:00:24,799 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:24,799 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:24,799 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:24,924 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:24,924 INFO [RS:0;jenkins-hbase4:46165] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46165,1676840421216; zookeeper connection closed. 2023-02-19 21:00:24,924 ERROR [Listener at localhost/46375-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a13578c rejected from java.util.concurrent.ThreadPoolExecutor@fa5c60b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:24,924 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:46165-0x1006e6230cb0001, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:24,924 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3d587742] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3d587742 2023-02-19 21:00:24,924 ERROR [Listener at localhost/46375-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4005cf4f rejected from java.util.concurrent.ThreadPoolExecutor@fa5c60b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:24,930 INFO [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43151,1676840421245; all regions closed. 2023-02-19 21:00:24,935 DEBUG [RS:1;jenkins-hbase4:43151] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/oldWALs 2023-02-19 21:00:24,935 INFO [RS:1;jenkins-hbase4:43151] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43151%2C1676840421245.meta:.meta(num 1676840422201) 2023-02-19 21:00:24,940 DEBUG [RS:1;jenkins-hbase4:43151] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/oldWALs 2023-02-19 21:00:24,940 INFO [RS:1;jenkins-hbase4:43151] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43151%2C1676840421245:(num 1676840422558) 2023-02-19 21:00:24,940 DEBUG [RS:1;jenkins-hbase4:43151] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:24,940 INFO [RS:1;jenkins-hbase4:43151] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:24,940 INFO [RS:1;jenkins-hbase4:43151] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:24,940 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:24,941 INFO [RS:1;jenkins-hbase4:43151] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43151 2023-02-19 21:00:24,943 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43151,1676840421245 2023-02-19 21:00:24,943 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:24,943 ERROR [Listener at localhost/46375-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1696502a rejected from java.util.concurrent.ThreadPoolExecutor@12a9d620[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:24,945 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43151,1676840421245] 2023-02-19 21:00:24,945 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43151,1676840421245; numProcessing=2 2023-02-19 21:00:24,946 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43151,1676840421245 already deleted, retry=false 2023-02-19 21:00:24,946 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43151,1676840421245 expired; onlineServers=0 2023-02-19 21:00:24,946 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38069,1676840421164' ***** 2023-02-19 21:00:24,946 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 21:00:24,946 DEBUG [M:0;jenkins-hbase4:38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65ff0549, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:24,946 INFO [M:0;jenkins-hbase4:38069] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38069,1676840421164 2023-02-19 21:00:24,947 INFO [M:0;jenkins-hbase4:38069] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38069,1676840421164; all regions closed. 2023-02-19 21:00:24,947 DEBUG [M:0;jenkins-hbase4:38069] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:24,947 DEBUG [M:0;jenkins-hbase4:38069] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 21:00:24,947 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 21:00:24,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840421438] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840421438,5,FailOnTimeoutGroup] 2023-02-19 21:00:24,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840421438] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840421438,5,FailOnTimeoutGroup] 2023-02-19 21:00:24,947 DEBUG [M:0;jenkins-hbase4:38069] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 21:00:24,948 INFO [M:0;jenkins-hbase4:38069] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 21:00:24,948 INFO [M:0;jenkins-hbase4:38069] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 21:00:24,948 INFO [M:0;jenkins-hbase4:38069] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 21:00:24,948 DEBUG [M:0;jenkins-hbase4:38069] master.HMaster(1512): Stopping service threads 2023-02-19 21:00:24,948 INFO [M:0;jenkins-hbase4:38069] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 21:00:24,949 ERROR [M:0;jenkins-hbase4:38069] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 21:00:24,949 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:24,949 INFO [M:0;jenkins-hbase4:38069] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 21:00:24,949 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:24,949 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 21:00:24,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:24,949 DEBUG [M:0;jenkins-hbase4:38069] zookeeper.ZKUtil(398): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 21:00:24,949 WARN [M:0;jenkins-hbase4:38069] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 21:00:24,949 INFO [M:0;jenkins-hbase4:38069] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 21:00:24,950 INFO [M:0;jenkins-hbase4:38069] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 21:00:24,950 DEBUG [M:0;jenkins-hbase4:38069] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:24,950 INFO [M:0;jenkins-hbase4:38069] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:24,950 DEBUG [M:0;jenkins-hbase4:38069] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:24,950 DEBUG [M:0;jenkins-hbase4:38069] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:24,951 DEBUG [M:0;jenkins-hbase4:38069] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:24,951 INFO [M:0;jenkins-hbase4:38069] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.89 KB heapSize=66.83 KB 2023-02-19 21:00:24,959 INFO [M:0;jenkins-hbase4:38069] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.89 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ad6eae2a0b4b44b88a6be9d0c0e7b7ce 2023-02-19 21:00:24,963 DEBUG [M:0;jenkins-hbase4:38069] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ad6eae2a0b4b44b88a6be9d0c0e7b7ce as hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ad6eae2a0b4b44b88a6be9d0c0e7b7ce 2023-02-19 21:00:24,967 INFO [M:0;jenkins-hbase4:38069] regionserver.HStore(1080): Added hdfs://localhost:40483/user/jenkins/test-data/7bd1cd10-2e0e-abbc-a556-106a11887a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ad6eae2a0b4b44b88a6be9d0c0e7b7ce, entries=17, sequenceid=132, filesize=8.7 K 2023-02-19 21:00:24,968 INFO [M:0;jenkins-hbase4:38069] regionserver.HRegion(2947): Finished flush of dataSize ~55.89 KB/57232, heapSize ~66.81 KB/68416, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-19 21:00:24,968 INFO [M:0;jenkins-hbase4:38069] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:24,968 DEBUG [M:0;jenkins-hbase4:38069] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:24,971 INFO [M:0;jenkins-hbase4:38069] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 21:00:24,971 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:24,971 INFO [M:0;jenkins-hbase4:38069] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38069 2023-02-19 21:00:24,974 DEBUG [M:0;jenkins-hbase4:38069] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38069,1676840421164 already deleted, retry=false 2023-02-19 21:00:25,325 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:25,325 INFO [M:0;jenkins-hbase4:38069] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38069,1676840421164; zookeeper connection closed. 2023-02-19 21:00:25,325 ERROR [Listener at localhost/46375-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43a4e4bb rejected from java.util.concurrent.ThreadPoolExecutor@479b6817[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:25,326 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1006e6230cb0000, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:25,326 ERROR [Listener at localhost/46375-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5734ad8f rejected from java.util.concurrent.ThreadPoolExecutor@479b6817[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:25,425 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:25,425 INFO [RS:1;jenkins-hbase4:43151] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43151,1676840421245; zookeeper connection closed. 2023-02-19 21:00:25,425 ERROR [Listener at localhost/46375-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4205d689 rejected from java.util.concurrent.ThreadPoolExecutor@12a9d620[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:25,425 DEBUG [Listener at localhost/46375-EventThread] zookeeper.ZKWatcher(600): regionserver:43151-0x1006e6230cb0002, quorum=127.0.0.1:60609, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:25,426 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5b8f0a83] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5b8f0a83 2023-02-19 21:00:25,426 ERROR [Listener at localhost/46375-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3af21bc3 rejected from java.util.concurrent.ThreadPoolExecutor@12a9d620[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:25,426 INFO [Listener at localhost/46375] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 21:00:25,426 WARN [Listener at localhost/46375] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:25,430 INFO [Listener at localhost/46375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:25,534 WARN [BP-909814747-172.31.14.131-1676840420405 heartbeating to localhost/127.0.0.1:40483] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:25,535 WARN [BP-909814747-172.31.14.131-1676840420405 heartbeating to localhost/127.0.0.1:40483] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-909814747-172.31.14.131-1676840420405 (Datanode Uuid 1712a20c-abd1-429b-992d-9b9788aef1b5) service to localhost/127.0.0.1:40483 2023-02-19 21:00:25,537 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/cluster_3389c8a9-178e-d84a-1f62-6e5be694de70/dfs/data/data3/current/BP-909814747-172.31.14.131-1676840420405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:25,537 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/cluster_3389c8a9-178e-d84a-1f62-6e5be694de70/dfs/data/data4/current/BP-909814747-172.31.14.131-1676840420405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:25,539 WARN [Listener at localhost/46375] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:25,557 INFO [Listener at localhost/46375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:25,661 WARN [BP-909814747-172.31.14.131-1676840420405 heartbeating to localhost/127.0.0.1:40483] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:25,661 WARN [BP-909814747-172.31.14.131-1676840420405 heartbeating to localhost/127.0.0.1:40483] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-909814747-172.31.14.131-1676840420405 (Datanode Uuid 0b304073-fcbb-46ee-82aa-3234e191ae46) service to localhost/127.0.0.1:40483 2023-02-19 21:00:25,662 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/cluster_3389c8a9-178e-d84a-1f62-6e5be694de70/dfs/data/data1/current/BP-909814747-172.31.14.131-1676840420405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:25,662 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/cluster_3389c8a9-178e-d84a-1f62-6e5be694de70/dfs/data/data2/current/BP-909814747-172.31.14.131-1676840420405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:25,675 INFO [Listener at localhost/46375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:25,793 INFO [Listener at localhost/46375] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 21:00:25,814 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 21:00:25,827 INFO [Listener at localhost/46375] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=176 (was 152) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:40483 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:40483 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:40483 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46375 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:40483 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:40483 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38069,1676840421164)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:40483 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40483 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=565 (was 530) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=315 (was 342), ProcessCount=170 (was 170), AvailableMemoryMB=9065 (was 9230) 2023-02-19 21:00:25,837 INFO [Listener at localhost/46375] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=176, OpenFileDescriptor=565, MaxFileDescriptor=60000, SystemLoadAverage=315, ProcessCount=170, AvailableMemoryMB=9065 2023-02-19 21:00:25,849 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/hadoop.log.dir so I do NOT create it in target/test-data/76974633-414a-385d-ccd9-6811fe704f23 2023-02-19 21:00:25,849 WARN [Listener at localhost/46375] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 21:00:25,849 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/hadoop.tmp.dir so I do NOT create it in target/test-data/76974633-414a-385d-ccd9-6811fe704f23 2023-02-19 21:00:25,849 WARN [Listener at localhost/46375] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac884959-99e5-d1b6-5b0b-3cd59ad67a1a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 21:00:25,849 DEBUG [Listener at localhost/46375] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23 2023-02-19 21:00:25,849 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 21:00:25,849 INFO [Listener at localhost/46375] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/cluster_dc685777-3cbf-810d-492c-7972792fa62e, deleteOnExit=true 2023-02-19 21:00:25,849 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 21:00:25,849 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/test.cache.data in system properties and HBase conf 2023-02-19 21:00:25,850 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 21:00:25,850 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/hadoop.log.dir in system properties and HBase conf 2023-02-19 21:00:25,850 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 21:00:25,850 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 21:00:25,850 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 21:00:25,850 DEBUG [Listener at localhost/46375] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 21:00:25,853 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 21:00:25,853 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 21:00:25,853 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 21:00:25,853 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 21:00:25,853 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 21:00:25,853 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 21:00:25,853 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 21:00:25,854 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 21:00:25,854 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 21:00:25,854 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/nfs.dump.dir in system properties and HBase conf 2023-02-19 21:00:25,854 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/java.io.tmpdir in system properties and HBase conf 2023-02-19 21:00:25,854 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 21:00:25,854 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 21:00:25,854 INFO [Listener at localhost/46375] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 21:00:25,858 WARN [Listener at localhost/46375] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 21:00:25,858 WARN [Listener at localhost/46375] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 21:00:25,899 WARN [Listener at localhost/46375] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:25,902 INFO [Listener at localhost/46375] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:25,908 INFO [Listener at localhost/46375] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/java.io.tmpdir/Jetty_localhost_42835_hdfs____70suti/webapp 2023-02-19 21:00:26,009 INFO [Listener at localhost/46375] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42835 2023-02-19 21:00:26,013 WARN [Listener at localhost/46375] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 21:00:26,014 WARN [Listener at localhost/46375] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 21:00:26,054 WARN [Listener at localhost/46315] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:26,065 WARN [Listener at localhost/46315] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 21:00:26,067 WARN [Listener at localhost/46315] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:26,068 INFO [Listener at localhost/46315] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:26,077 INFO [Listener at localhost/46315] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/java.io.tmpdir/Jetty_localhost_46869_datanode____.2xiqg0/webapp 2023-02-19 21:00:26,178 INFO [Listener at localhost/46315] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46869 2023-02-19 21:00:26,184 WARN [Listener at localhost/39453] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:26,205 WARN [Listener at localhost/39453] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 21:00:26,208 WARN [Listener at localhost/39453] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:26,209 INFO [Listener at localhost/39453] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:26,213 INFO [Listener at localhost/39453] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/java.io.tmpdir/Jetty_localhost_41333_datanode____.v6ez8j/webapp 2023-02-19 21:00:26,294 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf98f8a8a1120b761: Processing first storage report for DS-efc25a6f-6dce-4c3d-b76c-12f4add27b08 from datanode cf3b2580-5fb1-42cd-9072-fec1bcbeac73 2023-02-19 21:00:26,294 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf98f8a8a1120b761: from storage DS-efc25a6f-6dce-4c3d-b76c-12f4add27b08 node DatanodeRegistration(127.0.0.1:37103, datanodeUuid=cf3b2580-5fb1-42cd-9072-fec1bcbeac73, infoPort=32935, infoSecurePort=0, ipcPort=39453, storageInfo=lv=-57;cid=testClusterID;nsid=1398497162;c=1676840425861), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:26,294 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf98f8a8a1120b761: Processing first storage report for DS-73334ad2-a74b-4304-b71a-8570968b1f33 from datanode cf3b2580-5fb1-42cd-9072-fec1bcbeac73 2023-02-19 21:00:26,294 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf98f8a8a1120b761: from storage DS-73334ad2-a74b-4304-b71a-8570968b1f33 node DatanodeRegistration(127.0.0.1:37103, datanodeUuid=cf3b2580-5fb1-42cd-9072-fec1bcbeac73, infoPort=32935, infoSecurePort=0, ipcPort=39453, storageInfo=lv=-57;cid=testClusterID;nsid=1398497162;c=1676840425861), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:26,335 INFO [Listener at localhost/39453] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41333 2023-02-19 21:00:26,345 WARN [Listener at localhost/36919] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:26,443 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2348109229a8f0a9: Processing first storage report for DS-9470a8d5-5170-42bf-8432-254789094120 from datanode 7e08c0bd-f1e9-40e4-a734-c8d73063677b 2023-02-19 21:00:26,443 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2348109229a8f0a9: from storage DS-9470a8d5-5170-42bf-8432-254789094120 node DatanodeRegistration(127.0.0.1:33987, datanodeUuid=7e08c0bd-f1e9-40e4-a734-c8d73063677b, infoPort=46595, infoSecurePort=0, ipcPort=36919, storageInfo=lv=-57;cid=testClusterID;nsid=1398497162;c=1676840425861), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:26,443 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2348109229a8f0a9: Processing first storage report for DS-c4c95162-b8cb-48ff-b918-124aa1db7f9d from datanode 7e08c0bd-f1e9-40e4-a734-c8d73063677b 2023-02-19 21:00:26,443 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2348109229a8f0a9: from storage DS-c4c95162-b8cb-48ff-b918-124aa1db7f9d node DatanodeRegistration(127.0.0.1:33987, datanodeUuid=7e08c0bd-f1e9-40e4-a734-c8d73063677b, infoPort=46595, infoSecurePort=0, ipcPort=36919, storageInfo=lv=-57;cid=testClusterID;nsid=1398497162;c=1676840425861), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:26,459 DEBUG [Listener at localhost/36919] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23 2023-02-19 21:00:26,461 INFO [Listener at localhost/36919] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/cluster_dc685777-3cbf-810d-492c-7972792fa62e/zookeeper_0, clientPort=61237, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/cluster_dc685777-3cbf-810d-492c-7972792fa62e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/cluster_dc685777-3cbf-810d-492c-7972792fa62e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 21:00:26,462 INFO [Listener at localhost/36919] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61237 2023-02-19 21:00:26,462 INFO [Listener at localhost/36919] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:26,463 INFO [Listener at localhost/36919] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:26,476 INFO [Listener at localhost/36919] util.FSUtils(479): Created version file at hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a with version=8 2023-02-19 21:00:26,476 INFO [Listener at localhost/36919] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:26,477 INFO [Listener at localhost/36919] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:26,478 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/hbase-staging 2023-02-19 21:00:26,480 INFO [Listener at localhost/36919] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:26,480 INFO [Listener at localhost/36919] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:26,480 INFO [Listener at localhost/36919] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:26,480 INFO [Listener at localhost/36919] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:26,481 INFO [Listener at localhost/36919] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:26,481 INFO [Listener at localhost/36919] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:26,481 INFO [Listener at localhost/36919] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:26,481 INFO [Listener at localhost/36919] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38589 2023-02-19 21:00:26,482 INFO [Listener at localhost/36919] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:26,482 INFO [Listener at localhost/36919] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:26,483 INFO [Listener at localhost/36919] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38589 connecting to ZooKeeper ensemble=127.0.0.1:61237 2023-02-19 21:00:26,490 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:385890x0, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:26,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38589-0x1006e6245a10000 connected 2023-02-19 21:00:26,505 DEBUG [Listener at localhost/36919] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:26,506 DEBUG [Listener at localhost/36919] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:26,506 DEBUG [Listener at localhost/36919] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:26,506 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38589 2023-02-19 21:00:26,507 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38589 2023-02-19 21:00:26,507 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38589 2023-02-19 21:00:26,507 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38589 2023-02-19 21:00:26,507 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38589 2023-02-19 21:00:26,508 INFO [Listener at localhost/36919] master.HMaster(444): hbase.rootdir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a, hbase.cluster.distributed=false 2023-02-19 21:00:26,520 INFO [Listener at localhost/36919] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:26,520 INFO [Listener at localhost/36919] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:26,521 INFO [Listener at localhost/36919] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:26,521 INFO [Listener at localhost/36919] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:26,521 INFO [Listener at localhost/36919] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:26,521 INFO [Listener at localhost/36919] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:26,521 INFO [Listener at localhost/36919] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:26,522 INFO [Listener at localhost/36919] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36869 2023-02-19 21:00:26,522 INFO [Listener at localhost/36919] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 21:00:26,524 DEBUG [Listener at localhost/36919] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:26,524 INFO [Listener at localhost/36919] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:26,526 INFO [Listener at localhost/36919] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:26,527 INFO [Listener at localhost/36919] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36869 connecting to ZooKeeper ensemble=127.0.0.1:61237 2023-02-19 21:00:26,534 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:368690x0, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:26,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36869-0x1006e6245a10001 connected 2023-02-19 21:00:26,535 DEBUG [Listener at localhost/36919] zookeeper.ZKUtil(164): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:26,536 DEBUG [Listener at localhost/36919] zookeeper.ZKUtil(164): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:26,536 DEBUG [Listener at localhost/36919] zookeeper.ZKUtil(164): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:26,539 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36869 2023-02-19 21:00:26,539 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36869 2023-02-19 21:00:26,539 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36869 2023-02-19 21:00:26,539 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36869 2023-02-19 21:00:26,539 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36869 2023-02-19 21:00:26,552 INFO [Listener at localhost/36919] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:26,552 INFO [Listener at localhost/36919] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:26,552 INFO [Listener at localhost/36919] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:26,552 INFO [Listener at localhost/36919] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:26,552 INFO [Listener at localhost/36919] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:26,552 INFO [Listener at localhost/36919] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:26,552 INFO [Listener at localhost/36919] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:26,553 INFO [Listener at localhost/36919] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36745 2023-02-19 21:00:26,553 INFO [Listener at localhost/36919] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 21:00:26,555 DEBUG [Listener at localhost/36919] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:26,555 INFO [Listener at localhost/36919] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:26,557 INFO [Listener at localhost/36919] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:26,558 INFO [Listener at localhost/36919] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36745 connecting to ZooKeeper ensemble=127.0.0.1:61237 2023-02-19 21:00:26,563 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:367450x0, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:26,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36745-0x1006e6245a10002 connected 2023-02-19 21:00:26,565 DEBUG [Listener at localhost/36919] zookeeper.ZKUtil(164): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:26,565 DEBUG [Listener at localhost/36919] zookeeper.ZKUtil(164): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:26,565 DEBUG [Listener at localhost/36919] zookeeper.ZKUtil(164): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:26,566 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36745 2023-02-19 21:00:26,566 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36745 2023-02-19 21:00:26,566 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36745 2023-02-19 21:00:26,567 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36745 2023-02-19 21:00:26,567 DEBUG [Listener at localhost/36919] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36745 2023-02-19 21:00:26,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38589,1676840426480 2023-02-19 21:00:26,569 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 21:00:26,569 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38589,1676840426480 2023-02-19 21:00:26,570 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:26,571 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:26,571 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:26,571 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:26,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 21:00:26,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38589,1676840426480 from backup master directory 2023-02-19 21:00:26,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 21:00:26,575 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38589,1676840426480 2023-02-19 21:00:26,575 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 21:00:26,575 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:26,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38589,1676840426480 2023-02-19 21:00:26,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/hbase.id with ID: 66bea846-28e4-4c06-b6fa-29dfd3682c03 2023-02-19 21:00:26,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:26,594 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:26,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x50064498 to 127.0.0.1:61237 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:26,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fadc72d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:26,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:26,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 21:00:26,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:26,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/data/master/store-tmp 2023-02-19 21:00:26,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:26,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:26,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:26,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:26,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:26,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:26,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:26,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:26,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/WALs/jenkins-hbase4.apache.org,38589,1676840426480 2023-02-19 21:00:26,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38589%2C1676840426480, suffix=, logDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/WALs/jenkins-hbase4.apache.org,38589,1676840426480, archiveDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/oldWALs, maxLogs=10 2023-02-19 21:00:26,634 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33987,DS-9470a8d5-5170-42bf-8432-254789094120,DISK] 2023-02-19 21:00:26,635 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37103,DS-efc25a6f-6dce-4c3d-b76c-12f4add27b08,DISK] 2023-02-19 21:00:26,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/WALs/jenkins-hbase4.apache.org,38589,1676840426480/jenkins-hbase4.apache.org%2C38589%2C1676840426480.1676840426618 2023-02-19 21:00:26,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33987,DS-9470a8d5-5170-42bf-8432-254789094120,DISK], DatanodeInfoWithStorage[127.0.0.1:37103,DS-efc25a6f-6dce-4c3d-b76c-12f4add27b08,DISK]] 2023-02-19 21:00:26,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:26,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:26,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:26,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:26,639 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:26,641 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 21:00:26,641 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 21:00:26,641 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:26,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:26,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:26,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:26,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:26,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60197603, jitterRate=-0.10298581421375275}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 21:00:26,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:26,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 21:00:26,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 21:00:26,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 21:00:26,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 21:00:26,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 21:00:26,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 21:00:26,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 21:00:26,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 21:00:26,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 21:00:26,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 21:00:26,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 21:00:26,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 21:00:26,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 21:00:26,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 21:00:26,666 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:26,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 21:00:26,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 21:00:26,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 21:00:26,670 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:26,670 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:26,670 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:26,670 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:26,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38589,1676840426480, sessionid=0x1006e6245a10000, setting cluster-up flag (Was=false) 2023-02-19 21:00:26,675 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:26,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 21:00:26,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38589,1676840426480 2023-02-19 21:00:26,684 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:26,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 21:00:26,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38589,1676840426480 2023-02-19 21:00:26,689 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.hbase-snapshot/.tmp 2023-02-19 21:00:26,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:26,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:26,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:26,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:26,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:26,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 21:00:26,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:26,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676840456697 2023-02-19 21:00:26,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 21:00:26,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 21:00:26,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 21:00:26,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 21:00:26,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 21:00:26,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 21:00:26,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,699 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:26,699 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 21:00:26,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 21:00:26,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 21:00:26,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 21:00:26,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 21:00:26,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 21:00:26,700 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:26,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840426700,5,FailOnTimeoutGroup] 2023-02-19 21:00:26,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840426701,5,FailOnTimeoutGroup] 2023-02-19 21:00:26,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 21:00:26,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,712 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:26,712 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:26,713 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a 2023-02-19 21:00:26,769 INFO [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(952): ClusterId : 66bea846-28e4-4c06-b6fa-29dfd3682c03 2023-02-19 21:00:26,769 INFO [RS:1;jenkins-hbase4:36745] regionserver.HRegionServer(952): ClusterId : 66bea846-28e4-4c06-b6fa-29dfd3682c03 2023-02-19 21:00:26,769 DEBUG [RS:0;jenkins-hbase4:36869] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 21:00:26,769 DEBUG [RS:1;jenkins-hbase4:36745] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 21:00:26,771 DEBUG [RS:0;jenkins-hbase4:36869] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 21:00:26,771 DEBUG [RS:1;jenkins-hbase4:36745] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 21:00:26,771 DEBUG [RS:1;jenkins-hbase4:36745] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 21:00:26,771 DEBUG [RS:0;jenkins-hbase4:36869] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 21:00:26,774 DEBUG [RS:0;jenkins-hbase4:36869] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 21:00:26,775 DEBUG [RS:1;jenkins-hbase4:36745] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 21:00:26,776 DEBUG [RS:0;jenkins-hbase4:36869] zookeeper.ReadOnlyZKClient(139): Connect 0x2824ed7b to 127.0.0.1:61237 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:26,776 DEBUG [RS:1;jenkins-hbase4:36745] zookeeper.ReadOnlyZKClient(139): Connect 0x574fad75 to 127.0.0.1:61237 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:26,781 DEBUG [RS:1;jenkins-hbase4:36745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@598859ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:26,781 DEBUG [RS:0;jenkins-hbase4:36869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26e3060f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:26,782 DEBUG [RS:1;jenkins-hbase4:36745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5db7c605, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:26,782 DEBUG [RS:0;jenkins-hbase4:36869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22dc860b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:26,791 DEBUG [RS:1;jenkins-hbase4:36745] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36745 2023-02-19 21:00:26,791 INFO [RS:1;jenkins-hbase4:36745] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 21:00:26,791 INFO [RS:1;jenkins-hbase4:36745] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 21:00:26,791 DEBUG [RS:1;jenkins-hbase4:36745] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 21:00:26,791 DEBUG [RS:0;jenkins-hbase4:36869] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36869 2023-02-19 21:00:26,791 INFO [RS:0;jenkins-hbase4:36869] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 21:00:26,791 INFO [RS:0;jenkins-hbase4:36869] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 21:00:26,791 DEBUG [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 21:00:26,791 INFO [RS:1;jenkins-hbase4:36745] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38589,1676840426480 with isa=jenkins-hbase4.apache.org/172.31.14.131:36745, startcode=1676840426551 2023-02-19 21:00:26,791 INFO [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38589,1676840426480 with isa=jenkins-hbase4.apache.org/172.31.14.131:36869, startcode=1676840426520 2023-02-19 21:00:26,792 DEBUG [RS:1;jenkins-hbase4:36745] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 21:00:26,792 DEBUG [RS:0;jenkins-hbase4:36869] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 21:00:26,794 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60233, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 21:00:26,795 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58691, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 21:00:26,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38589] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:26,795 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:26,796 DEBUG [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a 2023-02-19 21:00:26,796 DEBUG [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46315 2023-02-19 21:00:26,796 DEBUG [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 21:00:26,796 DEBUG [RS:1;jenkins-hbase4:36745] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a 2023-02-19 21:00:26,796 DEBUG [RS:1;jenkins-hbase4:36745] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46315 2023-02-19 21:00:26,796 DEBUG [RS:1;jenkins-hbase4:36745] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 21:00:26,797 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:26,802 DEBUG [RS:0;jenkins-hbase4:36869] zookeeper.ZKUtil(162): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:26,802 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36869,1676840426520] 2023-02-19 21:00:26,802 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36745,1676840426551] 2023-02-19 21:00:26,802 WARN [RS:0;jenkins-hbase4:36869] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:26,802 INFO [RS:0;jenkins-hbase4:36869] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:26,802 DEBUG [RS:1;jenkins-hbase4:36745] zookeeper.ZKUtil(162): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:26,802 DEBUG [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/WALs/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:26,802 WARN [RS:1;jenkins-hbase4:36745] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:26,802 INFO [RS:1;jenkins-hbase4:36745] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:26,802 DEBUG [RS:1;jenkins-hbase4:36745] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/WALs/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:26,809 DEBUG [RS:0;jenkins-hbase4:36869] zookeeper.ZKUtil(162): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:26,809 DEBUG [RS:1;jenkins-hbase4:36745] zookeeper.ZKUtil(162): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:26,809 DEBUG [RS:0;jenkins-hbase4:36869] zookeeper.ZKUtil(162): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:26,809 DEBUG [RS:1;jenkins-hbase4:36745] zookeeper.ZKUtil(162): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:26,810 DEBUG [RS:0;jenkins-hbase4:36869] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 21:00:26,810 DEBUG [RS:1;jenkins-hbase4:36745] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 21:00:26,810 INFO [RS:0;jenkins-hbase4:36869] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 21:00:26,810 INFO [RS:1;jenkins-hbase4:36745] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 21:00:26,811 INFO [RS:0;jenkins-hbase4:36869] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 21:00:26,811 INFO [RS:0;jenkins-hbase4:36869] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 21:00:26,811 INFO [RS:0;jenkins-hbase4:36869] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,811 INFO [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 21:00:26,816 INFO [RS:1;jenkins-hbase4:36745] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 21:00:26,816 INFO [RS:0;jenkins-hbase4:36869] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,816 DEBUG [RS:0;jenkins-hbase4:36869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,816 INFO [RS:1;jenkins-hbase4:36745] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 21:00:26,816 DEBUG [RS:0;jenkins-hbase4:36869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,816 INFO [RS:1;jenkins-hbase4:36745] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,816 DEBUG [RS:0;jenkins-hbase4:36869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,816 DEBUG [RS:0;jenkins-hbase4:36869] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,816 DEBUG [RS:0;jenkins-hbase4:36869] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,816 DEBUG [RS:0;jenkins-hbase4:36869] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:26,816 DEBUG [RS:0;jenkins-hbase4:36869] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,817 DEBUG [RS:0;jenkins-hbase4:36869] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,817 INFO [RS:1;jenkins-hbase4:36745] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 21:00:26,817 DEBUG [RS:0;jenkins-hbase4:36869] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,817 DEBUG [RS:0;jenkins-hbase4:36869] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,818 INFO [RS:0;jenkins-hbase4:36869] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,818 INFO [RS:0;jenkins-hbase4:36869] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,818 INFO [RS:0;jenkins-hbase4:36869] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,821 INFO [RS:1;jenkins-hbase4:36745] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,821 DEBUG [RS:1;jenkins-hbase4:36745] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,821 DEBUG [RS:1;jenkins-hbase4:36745] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,821 DEBUG [RS:1;jenkins-hbase4:36745] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,821 DEBUG [RS:1;jenkins-hbase4:36745] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,821 DEBUG [RS:1;jenkins-hbase4:36745] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,821 DEBUG [RS:1;jenkins-hbase4:36745] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:26,821 DEBUG [RS:1;jenkins-hbase4:36745] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,821 DEBUG [RS:1;jenkins-hbase4:36745] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,821 DEBUG [RS:1;jenkins-hbase4:36745] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,821 DEBUG [RS:1;jenkins-hbase4:36745] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:26,823 INFO [RS:1;jenkins-hbase4:36745] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,823 INFO [RS:1;jenkins-hbase4:36745] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,823 INFO [RS:1;jenkins-hbase4:36745] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,832 INFO [RS:0;jenkins-hbase4:36869] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 21:00:26,832 INFO [RS:0;jenkins-hbase4:36869] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36869,1676840426520-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,834 INFO [RS:1;jenkins-hbase4:36745] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 21:00:26,834 INFO [RS:1;jenkins-hbase4:36745] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36745,1676840426551-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:26,843 INFO [RS:0;jenkins-hbase4:36869] regionserver.Replication(203): jenkins-hbase4.apache.org,36869,1676840426520 started 2023-02-19 21:00:26,843 INFO [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36869,1676840426520, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36869, sessionid=0x1006e6245a10001 2023-02-19 21:00:26,843 DEBUG [RS:0;jenkins-hbase4:36869] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 21:00:26,843 DEBUG [RS:0;jenkins-hbase4:36869] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:26,843 DEBUG [RS:0;jenkins-hbase4:36869] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36869,1676840426520' 2023-02-19 21:00:26,843 DEBUG [RS:0;jenkins-hbase4:36869] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:26,844 DEBUG [RS:0;jenkins-hbase4:36869] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:26,844 DEBUG [RS:0;jenkins-hbase4:36869] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 21:00:26,844 DEBUG [RS:0;jenkins-hbase4:36869] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 21:00:26,844 DEBUG [RS:0;jenkins-hbase4:36869] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:26,844 DEBUG [RS:0;jenkins-hbase4:36869] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36869,1676840426520' 2023-02-19 21:00:26,844 DEBUG [RS:0;jenkins-hbase4:36869] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:26,844 INFO [RS:1;jenkins-hbase4:36745] regionserver.Replication(203): jenkins-hbase4.apache.org,36745,1676840426551 started 2023-02-19 21:00:26,844 INFO [RS:1;jenkins-hbase4:36745] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36745,1676840426551, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36745, sessionid=0x1006e6245a10002 2023-02-19 21:00:26,844 DEBUG [RS:0;jenkins-hbase4:36869] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:26,845 DEBUG [RS:1;jenkins-hbase4:36745] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 21:00:26,845 DEBUG [RS:1;jenkins-hbase4:36745] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:26,845 DEBUG [RS:1;jenkins-hbase4:36745] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36745,1676840426551' 2023-02-19 21:00:26,845 DEBUG [RS:1;jenkins-hbase4:36745] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:26,845 DEBUG [RS:0;jenkins-hbase4:36869] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 21:00:26,845 INFO [RS:0;jenkins-hbase4:36869] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 21:00:26,845 INFO [RS:0;jenkins-hbase4:36869] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 21:00:26,845 DEBUG [RS:1;jenkins-hbase4:36745] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:26,845 DEBUG [RS:1;jenkins-hbase4:36745] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 21:00:26,845 DEBUG [RS:1;jenkins-hbase4:36745] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 21:00:26,845 DEBUG [RS:1;jenkins-hbase4:36745] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:26,845 DEBUG [RS:1;jenkins-hbase4:36745] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36745,1676840426551' 2023-02-19 21:00:26,845 DEBUG [RS:1;jenkins-hbase4:36745] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:26,846 DEBUG [RS:1;jenkins-hbase4:36745] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:26,846 DEBUG [RS:1;jenkins-hbase4:36745] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 21:00:26,846 INFO [RS:1;jenkins-hbase4:36745] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 21:00:26,846 INFO [RS:1;jenkins-hbase4:36745] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 21:00:27,127 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:27,129 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 21:00:27,130 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/info 2023-02-19 21:00:27,131 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 21:00:27,131 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:27,131 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 21:00:27,132 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:27,133 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 21:00:27,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:27,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 21:00:27,136 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/table 2023-02-19 21:00:27,136 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 21:00:27,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:27,137 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740 2023-02-19 21:00:27,137 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740 2023-02-19 21:00:27,140 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 21:00:27,141 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 21:00:27,143 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:27,143 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70772017, jitterRate=0.054585233330726624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 21:00:27,143 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 21:00:27,144 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:27,144 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:27,144 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:27,144 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:27,144 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:27,144 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:27,144 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:27,145 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:27,145 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 21:00:27,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 21:00:27,147 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 21:00:27,148 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 21:00:27,299 DEBUG [jenkins-hbase4:38589] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 21:00:27,299 DEBUG [jenkins-hbase4:38589] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:27,301 DEBUG [jenkins-hbase4:38589] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:27,301 DEBUG [jenkins-hbase4:38589] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:27,301 DEBUG [jenkins-hbase4:38589] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:27,302 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36869,1676840426520, state=OPENING 2023-02-19 21:00:27,303 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 21:00:27,305 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:27,305 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 21:00:27,305 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36869,1676840426520}] 2023-02-19 21:00:27,459 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:27,459 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 21:00:27,460 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56950, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 21:00:27,464 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 21:00:27,464 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:27,466 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36869%2C1676840426520.meta, suffix=.meta, logDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/WALs/jenkins-hbase4.apache.org,36869,1676840426520, archiveDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/oldWALs, maxLogs=32 2023-02-19 21:00:27,479 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33987,DS-9470a8d5-5170-42bf-8432-254789094120,DISK] 2023-02-19 21:00:27,481 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37103,DS-efc25a6f-6dce-4c3d-b76c-12f4add27b08,DISK] 2023-02-19 21:00:27,482 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/WALs/jenkins-hbase4.apache.org,36869,1676840426520/jenkins-hbase4.apache.org%2C36869%2C1676840426520.meta.1676840427466.meta 2023-02-19 21:00:27,482 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33987,DS-9470a8d5-5170-42bf-8432-254789094120,DISK], DatanodeInfoWithStorage[127.0.0.1:37103,DS-efc25a6f-6dce-4c3d-b76c-12f4add27b08,DISK]] 2023-02-19 21:00:27,482 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:27,483 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 21:00:27,483 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 21:00:27,483 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 21:00:27,483 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 21:00:27,483 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:27,483 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 21:00:27,483 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 21:00:27,484 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 21:00:27,485 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/info 2023-02-19 21:00:27,485 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/info 2023-02-19 21:00:27,485 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 21:00:27,486 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:27,486 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 21:00:27,487 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:27,487 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:27,487 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 21:00:27,488 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:27,488 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 21:00:27,488 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/table 2023-02-19 21:00:27,489 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/table 2023-02-19 21:00:27,489 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 21:00:27,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:27,490 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740 2023-02-19 21:00:27,491 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740 2023-02-19 21:00:27,493 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 21:00:27,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 21:00:27,495 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68990314, jitterRate=0.028035789728164673}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 21:00:27,495 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 21:00:27,495 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676840427459 2023-02-19 21:00:27,500 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 21:00:27,500 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 21:00:27,500 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36869,1676840426520, state=OPEN 2023-02-19 21:00:27,502 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 21:00:27,502 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 21:00:27,503 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 21:00:27,503 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36869,1676840426520 in 197 msec 2023-02-19 21:00:27,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 21:00:27,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 358 msec 2023-02-19 21:00:27,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 815 msec 2023-02-19 21:00:27,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676840427506, completionTime=-1 2023-02-19 21:00:27,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 21:00:27,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 21:00:27,510 DEBUG [hconnection-0x655a3de1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:27,511 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56952, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:27,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 21:00:27,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676840487513 2023-02-19 21:00:27,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676840547513 2023-02-19 21:00:27,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-19 21:00:27,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38589,1676840426480-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:27,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38589,1676840426480-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:27,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38589,1676840426480-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:27,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38589, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:27,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:27,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 21:00:27,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:27,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 21:00:27,522 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 21:00:27,522 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 21:00:27,523 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 21:00:27,525 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678 2023-02-19 21:00:27,525 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678 empty. 2023-02-19 21:00:27,526 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678 2023-02-19 21:00:27,526 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 21:00:27,560 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:27,569 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c14a09e9b8da3cf7b590ac48f2e2f678, NAME => 'hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp 2023-02-19 21:00:27,578 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:27,579 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c14a09e9b8da3cf7b590ac48f2e2f678, disabling compactions & flushes 2023-02-19 21:00:27,579 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. 2023-02-19 21:00:27,579 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. 2023-02-19 21:00:27,579 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. after waiting 0 ms 2023-02-19 21:00:27,579 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. 2023-02-19 21:00:27,579 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. 2023-02-19 21:00:27,579 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c14a09e9b8da3cf7b590ac48f2e2f678: 2023-02-19 21:00:27,582 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 21:00:27,583 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840427583"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840427583"}]},"ts":"1676840427583"} 2023-02-19 21:00:27,587 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 21:00:27,588 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 21:00:27,588 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840427588"}]},"ts":"1676840427588"} 2023-02-19 21:00:27,590 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 21:00:27,594 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:27,594 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:27,594 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:27,594 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:27,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c14a09e9b8da3cf7b590ac48f2e2f678, ASSIGN}] 2023-02-19 21:00:27,601 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c14a09e9b8da3cf7b590ac48f2e2f678, ASSIGN 2023-02-19 21:00:27,601 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c14a09e9b8da3cf7b590ac48f2e2f678, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36869,1676840426520; forceNewPlan=false, retain=false 2023-02-19 21:00:27,736 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 21:00:27,752 INFO [jenkins-hbase4:38589] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 21:00:27,754 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c14a09e9b8da3cf7b590ac48f2e2f678, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:27,754 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840427754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840427754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840427754"}]},"ts":"1676840427754"} 2023-02-19 21:00:27,756 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c14a09e9b8da3cf7b590ac48f2e2f678, server=jenkins-hbase4.apache.org,36869,1676840426520}] 2023-02-19 21:00:27,847 INFO [RS:0;jenkins-hbase4:36869] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36869%2C1676840426520, suffix=, logDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/WALs/jenkins-hbase4.apache.org,36869,1676840426520, archiveDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/oldWALs, maxLogs=32 2023-02-19 21:00:27,855 INFO [RS:1;jenkins-hbase4:36745] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36745%2C1676840426551, suffix=, logDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/WALs/jenkins-hbase4.apache.org,36745,1676840426551, archiveDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/oldWALs, maxLogs=32 2023-02-19 21:00:27,869 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33987,DS-9470a8d5-5170-42bf-8432-254789094120,DISK] 2023-02-19 21:00:27,870 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37103,DS-efc25a6f-6dce-4c3d-b76c-12f4add27b08,DISK] 2023-02-19 21:00:27,878 INFO [RS:0;jenkins-hbase4:36869] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/WALs/jenkins-hbase4.apache.org,36869,1676840426520/jenkins-hbase4.apache.org%2C36869%2C1676840426520.1676840427847 2023-02-19 21:00:27,880 DEBUG [RS:0;jenkins-hbase4:36869] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33987,DS-9470a8d5-5170-42bf-8432-254789094120,DISK], DatanodeInfoWithStorage[127.0.0.1:37103,DS-efc25a6f-6dce-4c3d-b76c-12f4add27b08,DISK]] 2023-02-19 21:00:27,904 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37103,DS-efc25a6f-6dce-4c3d-b76c-12f4add27b08,DISK] 2023-02-19 21:00:27,904 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33987,DS-9470a8d5-5170-42bf-8432-254789094120,DISK] 2023-02-19 21:00:27,908 INFO [RS:1;jenkins-hbase4:36745] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/WALs/jenkins-hbase4.apache.org,36745,1676840426551/jenkins-hbase4.apache.org%2C36745%2C1676840426551.1676840427856 2023-02-19 21:00:27,913 DEBUG [RS:1;jenkins-hbase4:36745] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37103,DS-efc25a6f-6dce-4c3d-b76c-12f4add27b08,DISK], DatanodeInfoWithStorage[127.0.0.1:33987,DS-9470a8d5-5170-42bf-8432-254789094120,DISK]] 2023-02-19 21:00:27,916 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. 2023-02-19 21:00:27,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c14a09e9b8da3cf7b590ac48f2e2f678, NAME => 'hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:27,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c14a09e9b8da3cf7b590ac48f2e2f678 2023-02-19 21:00:27,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:27,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c14a09e9b8da3cf7b590ac48f2e2f678 2023-02-19 21:00:27,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c14a09e9b8da3cf7b590ac48f2e2f678 2023-02-19 21:00:27,918 INFO [StoreOpener-c14a09e9b8da3cf7b590ac48f2e2f678-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c14a09e9b8da3cf7b590ac48f2e2f678 2023-02-19 21:00:27,920 DEBUG [StoreOpener-c14a09e9b8da3cf7b590ac48f2e2f678-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678/info 2023-02-19 21:00:27,920 DEBUG [StoreOpener-c14a09e9b8da3cf7b590ac48f2e2f678-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678/info 2023-02-19 21:00:27,920 INFO [StoreOpener-c14a09e9b8da3cf7b590ac48f2e2f678-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c14a09e9b8da3cf7b590ac48f2e2f678 columnFamilyName info 2023-02-19 21:00:27,921 INFO [StoreOpener-c14a09e9b8da3cf7b590ac48f2e2f678-1] regionserver.HStore(310): Store=c14a09e9b8da3cf7b590ac48f2e2f678/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:27,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678 2023-02-19 21:00:27,924 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678 2023-02-19 21:00:27,928 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c14a09e9b8da3cf7b590ac48f2e2f678 2023-02-19 21:00:27,930 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:27,930 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c14a09e9b8da3cf7b590ac48f2e2f678; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61638158, jitterRate=-0.08151987195014954}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 21:00:27,930 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c14a09e9b8da3cf7b590ac48f2e2f678: 2023-02-19 21:00:27,931 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678., pid=6, masterSystemTime=1676840427912 2023-02-19 21:00:27,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. 2023-02-19 21:00:27,934 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. 2023-02-19 21:00:27,937 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c14a09e9b8da3cf7b590ac48f2e2f678, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:27,937 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840427937"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840427937"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840427937"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840427937"}]},"ts":"1676840427937"} 2023-02-19 21:00:27,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 21:00:27,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c14a09e9b8da3cf7b590ac48f2e2f678, server=jenkins-hbase4.apache.org,36869,1676840426520 in 184 msec 2023-02-19 21:00:27,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 21:00:27,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c14a09e9b8da3cf7b590ac48f2e2f678, ASSIGN in 347 msec 2023-02-19 21:00:27,945 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 21:00:27,946 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840427945"}]},"ts":"1676840427945"} 2023-02-19 21:00:27,947 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 21:00:27,950 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 21:00:27,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 430 msec 2023-02-19 21:00:28,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 21:00:28,023 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:28,023 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:28,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 21:00:28,034 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:28,036 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-19 21:00:28,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 21:00:28,045 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:28,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-19 21:00:28,052 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 21:00:28,054 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 21:00:28,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.479sec 2023-02-19 21:00:28,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 21:00:28,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 21:00:28,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 21:00:28,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38589,1676840426480-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 21:00:28,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38589,1676840426480-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 21:00:28,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 21:00:28,070 DEBUG [Listener at localhost/36919] zookeeper.ReadOnlyZKClient(139): Connect 0x394ae7ca to 127.0.0.1:61237 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:28,074 DEBUG [Listener at localhost/36919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ac3c500, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:28,075 DEBUG [hconnection-0x2895cb46-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:28,077 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56958, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:28,078 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38589,1676840426480 2023-02-19 21:00:28,078 DEBUG [Listener at localhost/36919] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 21:00:28,080 DEBUG [Listener at localhost/36919] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 21:00:28,081 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55712, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 21:00:28,081 INFO [Listener at localhost/36919] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,082 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 21:00:28,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 93 connection: 172.31.14.131:55712 deadline: 1676840488082, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,082 INFO [Listener at localhost/36919] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-19 21:00:28,084 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:28,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,087 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 21:00:28,087 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-19 21:00:28,087 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 21:00:28,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:28,094 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:28,094 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:28,094 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:28,094 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:28,094 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:28,094 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:28,094 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:28,094 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:28,095 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd empty. 2023-02-19 21:00:28,095 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17 empty. 2023-02-19 21:00:28,095 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c empty. 2023-02-19 21:00:28,095 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867 empty. 2023-02-19 21:00:28,095 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b empty. 2023-02-19 21:00:28,095 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836 empty. 2023-02-19 21:00:28,095 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:28,095 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:28,095 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159 empty. 2023-02-19 21:00:28,096 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f empty. 2023-02-19 21:00:28,096 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b empty. 2023-02-19 21:00:28,096 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:28,096 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:28,096 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:28,096 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:28,096 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:28,096 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18 empty. 2023-02-19 21:00:28,096 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:28,096 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:28,096 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:28,096 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:28,097 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:28,097 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-19 21:00:28,106 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:28,108 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => e2168e49d07e10a19fc572df72cf50bd, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp 2023-02-19 21:00:28,108 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2db049a65e6635565eed2533a67d8159, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp 2023-02-19 21:00:28,108 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => c0388ad808943de6c7dc2df52080a97c, NAME => 'testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp 2023-02-19 21:00:28,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing e2168e49d07e10a19fc572df72cf50bd, disabling compactions & flushes 2023-02-19 21:00:28,115 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:28,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:28,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. after waiting 0 ms 2023-02-19 21:00:28,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:28,115 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:28,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for e2168e49d07e10a19fc572df72cf50bd: 2023-02-19 21:00:28,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 2db049a65e6635565eed2533a67d8159, disabling compactions & flushes 2023-02-19 21:00:28,116 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 91f9ad61a692d88a30724ae1b9195d5b, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp 2023-02-19 21:00:28,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,116 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:28,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing c0388ad808943de6c7dc2df52080a97c, disabling compactions & flushes 2023-02-19 21:00:28,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:28,116 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:28,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. after waiting 0 ms 2023-02-19 21:00:28,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:28,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:28,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. after waiting 0 ms 2023-02-19 21:00:28,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:28,116 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:28,116 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:28,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for c0388ad808943de6c7dc2df52080a97c: 2023-02-19 21:00:28,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 2db049a65e6635565eed2533a67d8159: 2023-02-19 21:00:28,117 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8a5bb8caaca1c08f803feb67df12422b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp 2023-02-19 21:00:28,117 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 581011ef8f897547ce6fb68ba1815867, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp 2023-02-19 21:00:28,123 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,123 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 91f9ad61a692d88a30724ae1b9195d5b, disabling compactions & flushes 2023-02-19 21:00:28,123 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:28,123 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:28,123 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. after waiting 0 ms 2023-02-19 21:00:28,123 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:28,123 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:28,123 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 91f9ad61a692d88a30724ae1b9195d5b: 2023-02-19 21:00:28,124 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6dff99fe8df12a16cd3ae0a3e51bb836, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp 2023-02-19 21:00:28,125 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,125 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 8a5bb8caaca1c08f803feb67df12422b, disabling compactions & flushes 2023-02-19 21:00:28,125 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:28,125 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:28,125 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. after waiting 0 ms 2023-02-19 21:00:28,126 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:28,126 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:28,126 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 8a5bb8caaca1c08f803feb67df12422b: 2023-02-19 21:00:28,126 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7759deae7bf8c2f4262d7d3aa6c6ae17, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp 2023-02-19 21:00:28,134 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,134 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 581011ef8f897547ce6fb68ba1815867, disabling compactions & flushes 2023-02-19 21:00:28,134 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:28,134 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:28,134 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. after waiting 0 ms 2023-02-19 21:00:28,134 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:28,134 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:28,134 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 581011ef8f897547ce6fb68ba1815867: 2023-02-19 21:00:28,135 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8527eef6fdb813a46ca9c74a5f40417f, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp 2023-02-19 21:00:28,139 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,139 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 6dff99fe8df12a16cd3ae0a3e51bb836, disabling compactions & flushes 2023-02-19 21:00:28,139 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:28,139 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:28,139 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. after waiting 0 ms 2023-02-19 21:00:28,139 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:28,139 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:28,139 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,139 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 6dff99fe8df12a16cd3ae0a3e51bb836: 2023-02-19 21:00:28,140 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 7759deae7bf8c2f4262d7d3aa6c6ae17, disabling compactions & flushes 2023-02-19 21:00:28,140 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:28,140 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0e78d795577e0972a2dde19200bbbe18, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp 2023-02-19 21:00:28,140 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:28,140 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. after waiting 0 ms 2023-02-19 21:00:28,140 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:28,140 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:28,140 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 7759deae7bf8c2f4262d7d3aa6c6ae17: 2023-02-19 21:00:28,142 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,142 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 8527eef6fdb813a46ca9c74a5f40417f, disabling compactions & flushes 2023-02-19 21:00:28,142 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:28,143 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:28,143 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. after waiting 0 ms 2023-02-19 21:00:28,143 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:28,143 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:28,143 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 8527eef6fdb813a46ca9c74a5f40417f: 2023-02-19 21:00:28,150 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,150 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 0e78d795577e0972a2dde19200bbbe18, disabling compactions & flushes 2023-02-19 21:00:28,150 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:28,150 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:28,150 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. after waiting 0 ms 2023-02-19 21:00:28,150 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:28,150 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:28,150 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 0e78d795577e0972a2dde19200bbbe18: 2023-02-19 21:00:28,152 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 21:00:28,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840428153"}]},"ts":"1676840428153"} 2023-02-19 21:00:28,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676840428153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840428153"}]},"ts":"1676840428153"} 2023-02-19 21:00:28,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840428153"}]},"ts":"1676840428153"} 2023-02-19 21:00:28,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840428153"}]},"ts":"1676840428153"} 2023-02-19 21:00:28,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840428153"}]},"ts":"1676840428153"} 2023-02-19 21:00:28,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840428153"}]},"ts":"1676840428153"} 2023-02-19 21:00:28,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840428153"}]},"ts":"1676840428153"} 2023-02-19 21:00:28,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840428153"}]},"ts":"1676840428153"} 2023-02-19 21:00:28,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840428153"}]},"ts":"1676840428153"} 2023-02-19 21:00:28,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676840428153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840428153"}]},"ts":"1676840428153"} 2023-02-19 21:00:28,156 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-19 21:00:28,156 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 21:00:28,157 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840428157"}]},"ts":"1676840428157"} 2023-02-19 21:00:28,158 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-19 21:00:28,162 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:28,167 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:28,167 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:28,167 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:28,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c0388ad808943de6c7dc2df52080a97c, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2db049a65e6635565eed2533a67d8159, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2168e49d07e10a19fc572df72cf50bd, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91f9ad61a692d88a30724ae1b9195d5b, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a5bb8caaca1c08f803feb67df12422b, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=581011ef8f897547ce6fb68ba1815867, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6dff99fe8df12a16cd3ae0a3e51bb836, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7759deae7bf8c2f4262d7d3aa6c6ae17, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8527eef6fdb813a46ca9c74a5f40417f, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0e78d795577e0972a2dde19200bbbe18, ASSIGN}] 2023-02-19 21:00:28,170 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2db049a65e6635565eed2533a67d8159, ASSIGN 2023-02-19 21:00:28,170 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2168e49d07e10a19fc572df72cf50bd, ASSIGN 2023-02-19 21:00:28,170 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91f9ad61a692d88a30724ae1b9195d5b, ASSIGN 2023-02-19 21:00:28,170 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c0388ad808943de6c7dc2df52080a97c, ASSIGN 2023-02-19 21:00:28,170 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2db049a65e6635565eed2533a67d8159, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36745,1676840426551; forceNewPlan=false, retain=false 2023-02-19 21:00:28,170 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0e78d795577e0972a2dde19200bbbe18, ASSIGN 2023-02-19 21:00:28,170 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2168e49d07e10a19fc572df72cf50bd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36745,1676840426551; forceNewPlan=false, retain=false 2023-02-19 21:00:28,170 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c0388ad808943de6c7dc2df52080a97c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36869,1676840426520; forceNewPlan=false, retain=false 2023-02-19 21:00:28,170 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91f9ad61a692d88a30724ae1b9195d5b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36869,1676840426520; forceNewPlan=false, retain=false 2023-02-19 21:00:28,171 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0e78d795577e0972a2dde19200bbbe18, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36869,1676840426520; forceNewPlan=false, retain=false 2023-02-19 21:00:28,171 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8527eef6fdb813a46ca9c74a5f40417f, ASSIGN 2023-02-19 21:00:28,171 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7759deae7bf8c2f4262d7d3aa6c6ae17, ASSIGN 2023-02-19 21:00:28,171 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6dff99fe8df12a16cd3ae0a3e51bb836, ASSIGN 2023-02-19 21:00:28,171 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=581011ef8f897547ce6fb68ba1815867, ASSIGN 2023-02-19 21:00:28,172 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a5bb8caaca1c08f803feb67df12422b, ASSIGN 2023-02-19 21:00:28,172 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8527eef6fdb813a46ca9c74a5f40417f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36745,1676840426551; forceNewPlan=false, retain=false 2023-02-19 21:00:28,172 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6dff99fe8df12a16cd3ae0a3e51bb836, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36745,1676840426551; forceNewPlan=false, retain=false 2023-02-19 21:00:28,172 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=581011ef8f897547ce6fb68ba1815867, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36869,1676840426520; forceNewPlan=false, retain=false 2023-02-19 21:00:28,172 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7759deae7bf8c2f4262d7d3aa6c6ae17, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36869,1676840426520; forceNewPlan=false, retain=false 2023-02-19 21:00:28,172 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a5bb8caaca1c08f803feb67df12422b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36745,1676840426551; forceNewPlan=false, retain=false 2023-02-19 21:00:28,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:28,321 INFO [jenkins-hbase4:38589] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-19 21:00:28,329 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=0e78d795577e0972a2dde19200bbbe18, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,329 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=581011ef8f897547ce6fb68ba1815867, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,329 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676840428329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840428329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840428329"}]},"ts":"1676840428329"} 2023-02-19 21:00:28,329 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=91f9ad61a692d88a30724ae1b9195d5b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,329 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840428329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840428329"}]},"ts":"1676840428329"} 2023-02-19 21:00:28,329 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840428329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840428329"}]},"ts":"1676840428329"} 2023-02-19 21:00:28,329 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c0388ad808943de6c7dc2df52080a97c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,329 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=7759deae7bf8c2f4262d7d3aa6c6ae17, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,330 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676840428329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840428329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840428329"}]},"ts":"1676840428329"} 2023-02-19 21:00:28,330 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840428329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840428329"}]},"ts":"1676840428329"} 2023-02-19 21:00:28,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 0e78d795577e0972a2dde19200bbbe18, server=jenkins-hbase4.apache.org,36869,1676840426520}] 2023-02-19 21:00:28,332 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 581011ef8f897547ce6fb68ba1815867, server=jenkins-hbase4.apache.org,36869,1676840426520}] 2023-02-19 21:00:28,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=14, state=RUNNABLE; OpenRegionProcedure 91f9ad61a692d88a30724ae1b9195d5b, server=jenkins-hbase4.apache.org,36869,1676840426520}] 2023-02-19 21:00:28,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure c0388ad808943de6c7dc2df52080a97c, server=jenkins-hbase4.apache.org,36869,1676840426520}] 2023-02-19 21:00:28,334 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=18, state=RUNNABLE; OpenRegionProcedure 7759deae7bf8c2f4262d7d3aa6c6ae17, server=jenkins-hbase4.apache.org,36869,1676840426520}] 2023-02-19 21:00:28,335 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6dff99fe8df12a16cd3ae0a3e51bb836, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,335 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428335"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840428335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840428335"}]},"ts":"1676840428335"} 2023-02-19 21:00:28,335 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8a5bb8caaca1c08f803feb67df12422b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,335 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428335"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840428335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840428335"}]},"ts":"1676840428335"} 2023-02-19 21:00:28,336 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e2168e49d07e10a19fc572df72cf50bd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,336 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840428336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840428336"}]},"ts":"1676840428336"} 2023-02-19 21:00:28,337 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=2db049a65e6635565eed2533a67d8159, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,337 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840428337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840428337"}]},"ts":"1676840428337"} 2023-02-19 21:00:28,337 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=8527eef6fdb813a46ca9c74a5f40417f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,338 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840428337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840428337"}]},"ts":"1676840428337"} 2023-02-19 21:00:28,338 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure 6dff99fe8df12a16cd3ae0a3e51bb836, server=jenkins-hbase4.apache.org,36745,1676840426551}] 2023-02-19 21:00:28,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=15, state=RUNNABLE; OpenRegionProcedure 8a5bb8caaca1c08f803feb67df12422b, server=jenkins-hbase4.apache.org,36745,1676840426551}] 2023-02-19 21:00:28,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure e2168e49d07e10a19fc572df72cf50bd, server=jenkins-hbase4.apache.org,36745,1676840426551}] 2023-02-19 21:00:28,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure 2db049a65e6635565eed2533a67d8159, server=jenkins-hbase4.apache.org,36745,1676840426551}] 2023-02-19 21:00:28,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=19, state=RUNNABLE; OpenRegionProcedure 8527eef6fdb813a46ca9c74a5f40417f, server=jenkins-hbase4.apache.org,36745,1676840426551}] 2023-02-19 21:00:28,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:28,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:28,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0e78d795577e0972a2dde19200bbbe18, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-19 21:00:28,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:28,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:28,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:28,489 INFO [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:28,490 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,490 DEBUG [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/f1 2023-02-19 21:00:28,490 DEBUG [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/f1 2023-02-19 21:00:28,490 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 21:00:28,491 INFO [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e78d795577e0972a2dde19200bbbe18 columnFamilyName f1 2023-02-19 21:00:28,491 INFO [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] regionserver.HStore(310): Store=0e78d795577e0972a2dde19200bbbe18/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,491 INFO [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:28,492 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45084, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 21:00:28,493 DEBUG [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/f2 2023-02-19 21:00:28,493 DEBUG [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/f2 2023-02-19 21:00:28,493 INFO [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e78d795577e0972a2dde19200bbbe18 columnFamilyName f2 2023-02-19 21:00:28,494 INFO [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] regionserver.HStore(310): Store=0e78d795577e0972a2dde19200bbbe18/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:28,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:28,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:28,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6dff99fe8df12a16cd3ae0a3e51bb836, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-19 21:00:28,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:28,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:28,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:28,498 INFO [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:28,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:28,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:28,500 DEBUG [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1 2023-02-19 21:00:28,500 DEBUG [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1 2023-02-19 21:00:28,501 INFO [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dff99fe8df12a16cd3ae0a3e51bb836 columnFamilyName f1 2023-02-19 21:00:28,502 INFO [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] regionserver.HStore(310): Store=6dff99fe8df12a16cd3ae0a3e51bb836/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,502 INFO [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:28,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:28,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0e78d795577e0972a2dde19200bbbe18; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69285967, jitterRate=0.032441362738609314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:28,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0e78d795577e0972a2dde19200bbbe18: 2023-02-19 21:00:28,503 DEBUG [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2 2023-02-19 21:00:28,503 DEBUG [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2 2023-02-19 21:00:28,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18., pid=21, masterSystemTime=1676840428483 2023-02-19 21:00:28,504 INFO [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dff99fe8df12a16cd3ae0a3e51bb836 columnFamilyName f2 2023-02-19 21:00:28,505 INFO [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] regionserver.HStore(310): Store=6dff99fe8df12a16cd3ae0a3e51bb836/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:28,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:28,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:28,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:28,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:28,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:28,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7759deae7bf8c2f4262d7d3aa6c6ae17, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-19 21:00:28,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:28,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:28,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:28,509 INFO [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:28,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:28,510 DEBUG [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1 2023-02-19 21:00:28,510 DEBUG [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1 2023-02-19 21:00:28,511 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=0e78d795577e0972a2dde19200bbbe18, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,511 INFO [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7759deae7bf8c2f4262d7d3aa6c6ae17 columnFamilyName f1 2023-02-19 21:00:28,511 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676840428511"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840428511"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840428511"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840428511"}]},"ts":"1676840428511"} 2023-02-19 21:00:28,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:28,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6dff99fe8df12a16cd3ae0a3e51bb836; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65427318, jitterRate=-0.02505698800086975}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:28,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6dff99fe8df12a16cd3ae0a3e51bb836: 2023-02-19 21:00:28,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836., pid=26, masterSystemTime=1676840428490 2023-02-19 21:00:28,515 INFO [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] regionserver.HStore(310): Store=7759deae7bf8c2f4262d7d3aa6c6ae17/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,515 INFO [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:28,516 DEBUG [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2 2023-02-19 21:00:28,516 DEBUG [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2 2023-02-19 21:00:28,516 INFO [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7759deae7bf8c2f4262d7d3aa6c6ae17 columnFamilyName f2 2023-02-19 21:00:28,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:28,517 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-19 21:00:28,517 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6dff99fe8df12a16cd3ae0a3e51bb836, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,517 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 0e78d795577e0972a2dde19200bbbe18, server=jenkins-hbase4.apache.org,36869,1676840426520 in 184 msec 2023-02-19 21:00:28,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:28,518 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428517"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840428517"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840428517"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840428517"}]},"ts":"1676840428517"} 2023-02-19 21:00:28,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:28,518 INFO [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] regionserver.HStore(310): Store=7759deae7bf8c2f4262d7d3aa6c6ae17/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8527eef6fdb813a46ca9c74a5f40417f, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-19 21:00:28,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:28,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:28,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:28,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0e78d795577e0972a2dde19200bbbe18, ASSIGN in 350 msec 2023-02-19 21:00:28,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:28,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:28,520 INFO [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:28,521 DEBUG [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1 2023-02-19 21:00:28,522 DEBUG [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1 2023-02-19 21:00:28,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:28,522 INFO [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8527eef6fdb813a46ca9c74a5f40417f columnFamilyName f1 2023-02-19 21:00:28,522 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-19 21:00:28,522 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure 6dff99fe8df12a16cd3ae0a3e51bb836, server=jenkins-hbase4.apache.org,36745,1676840426551 in 181 msec 2023-02-19 21:00:28,522 INFO [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] regionserver.HStore(310): Store=8527eef6fdb813a46ca9c74a5f40417f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,523 INFO [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:28,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:28,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6dff99fe8df12a16cd3ae0a3e51bb836, ASSIGN in 355 msec 2023-02-19 21:00:28,524 DEBUG [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2 2023-02-19 21:00:28,524 DEBUG [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2 2023-02-19 21:00:28,524 INFO [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8527eef6fdb813a46ca9c74a5f40417f columnFamilyName f2 2023-02-19 21:00:28,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:28,525 INFO [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] regionserver.HStore(310): Store=8527eef6fdb813a46ca9c74a5f40417f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7759deae7bf8c2f4262d7d3aa6c6ae17; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71602169, jitterRate=0.06695546209812164}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:28,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7759deae7bf8c2f4262d7d3aa6c6ae17: 2023-02-19 21:00:28,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:28,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:28,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17., pid=25, masterSystemTime=1676840428483 2023-02-19 21:00:28,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:28,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:28,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:28,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 581011ef8f897547ce6fb68ba1815867, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-19 21:00:28,528 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=7759deae7bf8c2f4262d7d3aa6c6ae17, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,528 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428528"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840428528"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840428528"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840428528"}]},"ts":"1676840428528"} 2023-02-19 21:00:28,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:28,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:28,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:28,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:28,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:28,531 INFO [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:28,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=18 2023-02-19 21:00:28,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=18, state=SUCCESS; OpenRegionProcedure 7759deae7bf8c2f4262d7d3aa6c6ae17, server=jenkins-hbase4.apache.org,36869,1676840426520 in 196 msec 2023-02-19 21:00:28,532 DEBUG [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1 2023-02-19 21:00:28,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:28,533 DEBUG [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1 2023-02-19 21:00:28,533 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7759deae7bf8c2f4262d7d3aa6c6ae17, ASSIGN in 365 msec 2023-02-19 21:00:28,533 INFO [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 581011ef8f897547ce6fb68ba1815867 columnFamilyName f1 2023-02-19 21:00:28,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8527eef6fdb813a46ca9c74a5f40417f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59010349, jitterRate=-0.12067727744579315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:28,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8527eef6fdb813a46ca9c74a5f40417f: 2023-02-19 21:00:28,534 INFO [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] regionserver.HStore(310): Store=581011ef8f897547ce6fb68ba1815867/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,534 INFO [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:28,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f., pid=30, masterSystemTime=1676840428490 2023-02-19 21:00:28,535 DEBUG [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2 2023-02-19 21:00:28,535 DEBUG [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2 2023-02-19 21:00:28,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:28,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:28,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:28,535 INFO [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 581011ef8f897547ce6fb68ba1815867 columnFamilyName f2 2023-02-19 21:00:28,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e2168e49d07e10a19fc572df72cf50bd, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-19 21:00:28,535 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=8527eef6fdb813a46ca9c74a5f40417f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:28,536 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428535"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840428535"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840428535"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840428535"}]},"ts":"1676840428535"} 2023-02-19 21:00:28,536 INFO [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] regionserver.HStore(310): Store=581011ef8f897547ce6fb68ba1815867/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:28,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:28,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:28,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:28,537 INFO [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:28,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:28,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=19 2023-02-19 21:00:28,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=19, state=SUCCESS; OpenRegionProcedure 8527eef6fdb813a46ca9c74a5f40417f, server=jenkins-hbase4.apache.org,36745,1676840426551 in 196 msec 2023-02-19 21:00:28,539 DEBUG [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1 2023-02-19 21:00:28,539 DEBUG [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1 2023-02-19 21:00:28,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8527eef6fdb813a46ca9c74a5f40417f, ASSIGN in 372 msec 2023-02-19 21:00:28,540 INFO [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2168e49d07e10a19fc572df72cf50bd columnFamilyName f1 2023-02-19 21:00:28,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:28,541 INFO [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] regionserver.HStore(310): Store=e2168e49d07e10a19fc572df72cf50bd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,541 INFO [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:28,542 DEBUG [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2 2023-02-19 21:00:28,542 DEBUG [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2 2023-02-19 21:00:28,542 INFO [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2168e49d07e10a19fc572df72cf50bd columnFamilyName f2 2023-02-19 21:00:28,542 INFO [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] regionserver.HStore(310): Store=e2168e49d07e10a19fc572df72cf50bd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:28,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:28,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:28,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 581011ef8f897547ce6fb68ba1815867; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74063784, jitterRate=0.10363638401031494}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:28,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 581011ef8f897547ce6fb68ba1815867: 2023-02-19 21:00:28,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867., pid=22, masterSystemTime=1676840428483 2023-02-19 21:00:28,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:28,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:28,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:28,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:28,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c0388ad808943de6c7dc2df52080a97c, NAME => 'testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-19 21:00:28,546 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=581011ef8f897547ce6fb68ba1815867, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,547 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428546"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840428546"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840428546"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840428546"}]},"ts":"1676840428546"} 2023-02-19 21:00:28,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:28,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:28,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:28,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:28,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-19 21:00:28,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 581011ef8f897547ce6fb68ba1815867, server=jenkins-hbase4.apache.org,36869,1676840426520 in 216 msec 2023-02-19 21:00:28,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=581011ef8f897547ce6fb68ba1815867, ASSIGN in 383 msec 2023-02-19 21:00:28,551 INFO [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:28,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:28,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e2168e49d07e10a19fc572df72cf50bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69895300, jitterRate=0.04152113199234009}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:28,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e2168e49d07e10a19fc572df72cf50bd: 2023-02-19 21:00:28,552 DEBUG [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/f1 2023-02-19 21:00:28,553 DEBUG [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/f1 2023-02-19 21:00:28,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd., pid=28, masterSystemTime=1676840428490 2023-02-19 21:00:28,553 INFO [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0388ad808943de6c7dc2df52080a97c columnFamilyName f1 2023-02-19 21:00:28,553 INFO [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] regionserver.HStore(310): Store=c0388ad808943de6c7dc2df52080a97c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,554 INFO [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:28,555 DEBUG [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/f2 2023-02-19 21:00:28,555 DEBUG [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/f2 2023-02-19 21:00:28,555 INFO [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0388ad808943de6c7dc2df52080a97c columnFamilyName f2 2023-02-19 21:00:28,556 INFO [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] regionserver.HStore(310): Store=c0388ad808943de6c7dc2df52080a97c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:28,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:28,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:28,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2db049a65e6635565eed2533a67d8159, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-19 21:00:28,557 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e2168e49d07e10a19fc572df72cf50bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,557 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428556"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840428556"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840428556"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840428556"}]},"ts":"1676840428556"} 2023-02-19 21:00:28,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:28,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:28,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:28,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:28,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:28,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:28,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-19 21:00:28,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure e2168e49d07e10a19fc572df72cf50bd, server=jenkins-hbase4.apache.org,36745,1676840426551 in 218 msec 2023-02-19 21:00:28,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:28,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2168e49d07e10a19fc572df72cf50bd, ASSIGN in 393 msec 2023-02-19 21:00:28,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:28,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c0388ad808943de6c7dc2df52080a97c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59003499, jitterRate=-0.12077935039997101}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:28,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c0388ad808943de6c7dc2df52080a97c: 2023-02-19 21:00:28,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c., pid=24, masterSystemTime=1676840428483 2023-02-19 21:00:28,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:28,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:28,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:28,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 91f9ad61a692d88a30724ae1b9195d5b, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-19 21:00:28,567 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c0388ad808943de6c7dc2df52080a97c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,567 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676840428567"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840428567"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840428567"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840428567"}]},"ts":"1676840428567"} 2023-02-19 21:00:28,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:28,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:28,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:28,568 INFO [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:28,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-19 21:00:28,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure c0388ad808943de6c7dc2df52080a97c, server=jenkins-hbase4.apache.org,36869,1676840426520 in 235 msec 2023-02-19 21:00:28,570 DEBUG [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1 2023-02-19 21:00:28,570 DEBUG [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1 2023-02-19 21:00:28,570 INFO [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91f9ad61a692d88a30724ae1b9195d5b columnFamilyName f1 2023-02-19 21:00:28,570 INFO [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] regionserver.HStore(310): Store=91f9ad61a692d88a30724ae1b9195d5b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,571 INFO [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:28,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c0388ad808943de6c7dc2df52080a97c, ASSIGN in 402 msec 2023-02-19 21:00:28,572 DEBUG [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2 2023-02-19 21:00:28,572 DEBUG [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2 2023-02-19 21:00:28,572 INFO [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91f9ad61a692d88a30724ae1b9195d5b columnFamilyName f2 2023-02-19 21:00:28,572 INFO [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] regionserver.HStore(310): Store=91f9ad61a692d88a30724ae1b9195d5b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,573 INFO [StoreOpener-2db049a65e6635565eed2533a67d8159-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:28,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:28,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:28,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:28,579 DEBUG [StoreOpener-2db049a65e6635565eed2533a67d8159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1 2023-02-19 21:00:28,579 DEBUG [StoreOpener-2db049a65e6635565eed2533a67d8159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1 2023-02-19 21:00:28,579 INFO [StoreOpener-2db049a65e6635565eed2533a67d8159-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2db049a65e6635565eed2533a67d8159 columnFamilyName f1 2023-02-19 21:00:28,580 INFO [StoreOpener-2db049a65e6635565eed2533a67d8159-1] regionserver.HStore(310): Store=2db049a65e6635565eed2533a67d8159/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,580 INFO [StoreOpener-2db049a65e6635565eed2533a67d8159-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:28,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:28,581 DEBUG [StoreOpener-2db049a65e6635565eed2533a67d8159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2 2023-02-19 21:00:28,581 DEBUG [StoreOpener-2db049a65e6635565eed2533a67d8159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2 2023-02-19 21:00:28,581 INFO [StoreOpener-2db049a65e6635565eed2533a67d8159-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2db049a65e6635565eed2533a67d8159 columnFamilyName f2 2023-02-19 21:00:28,582 INFO [StoreOpener-2db049a65e6635565eed2533a67d8159-1] regionserver.HStore(310): Store=2db049a65e6635565eed2533a67d8159/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:28,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:28,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:28,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 91f9ad61a692d88a30724ae1b9195d5b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72169074, jitterRate=0.07540300488471985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:28,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 91f9ad61a692d88a30724ae1b9195d5b: 2023-02-19 21:00:28,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b., pid=23, masterSystemTime=1676840428483 2023-02-19 21:00:28,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:28,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:28,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:28,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:28,592 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=91f9ad61a692d88a30724ae1b9195d5b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,592 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428592"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840428592"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840428592"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840428592"}]},"ts":"1676840428592"} 2023-02-19 21:00:28,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=14 2023-02-19 21:00:28,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=14, state=SUCCESS; OpenRegionProcedure 91f9ad61a692d88a30724ae1b9195d5b, server=jenkins-hbase4.apache.org,36869,1676840426520 in 262 msec 2023-02-19 21:00:28,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91f9ad61a692d88a30724ae1b9195d5b, ASSIGN in 429 msec 2023-02-19 21:00:28,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:28,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2db049a65e6635565eed2533a67d8159; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67946210, jitterRate=0.01247742772102356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:28,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2db049a65e6635565eed2533a67d8159: 2023-02-19 21:00:28,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159., pid=29, masterSystemTime=1676840428490 2023-02-19 21:00:28,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:28,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:28,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:28,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8a5bb8caaca1c08f803feb67df12422b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-19 21:00:28,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:28,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:28,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:28,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:28,601 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=2db049a65e6635565eed2533a67d8159, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,601 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428601"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840428601"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840428601"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840428601"}]},"ts":"1676840428601"} 2023-02-19 21:00:28,601 INFO [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:28,603 DEBUG [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1 2023-02-19 21:00:28,603 DEBUG [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1 2023-02-19 21:00:28,603 INFO [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a5bb8caaca1c08f803feb67df12422b columnFamilyName f1 2023-02-19 21:00:28,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-19 21:00:28,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure 2db049a65e6635565eed2533a67d8159, server=jenkins-hbase4.apache.org,36745,1676840426551 in 262 msec 2023-02-19 21:00:28,604 INFO [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] regionserver.HStore(310): Store=8a5bb8caaca1c08f803feb67df12422b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,604 INFO [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:28,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2db049a65e6635565eed2533a67d8159, ASSIGN in 437 msec 2023-02-19 21:00:28,605 DEBUG [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2 2023-02-19 21:00:28,605 DEBUG [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2 2023-02-19 21:00:28,605 INFO [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a5bb8caaca1c08f803feb67df12422b columnFamilyName f2 2023-02-19 21:00:28,606 INFO [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] regionserver.HStore(310): Store=8a5bb8caaca1c08f803feb67df12422b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:28,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:28,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:28,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:28,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:28,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:28,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8a5bb8caaca1c08f803feb67df12422b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67422319, jitterRate=0.004670843482017517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:28,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8a5bb8caaca1c08f803feb67df12422b: 2023-02-19 21:00:28,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b., pid=27, masterSystemTime=1676840428490 2023-02-19 21:00:28,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:28,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:28,615 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8a5bb8caaca1c08f803feb67df12422b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,616 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840428615"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840428615"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840428615"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840428615"}]},"ts":"1676840428615"} 2023-02-19 21:00:28,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=15 2023-02-19 21:00:28,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=15, state=SUCCESS; OpenRegionProcedure 8a5bb8caaca1c08f803feb67df12422b, server=jenkins-hbase4.apache.org,36745,1676840426551 in 279 msec 2023-02-19 21:00:28,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-19 21:00:28,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a5bb8caaca1c08f803feb67df12422b, ASSIGN in 451 msec 2023-02-19 21:00:28,620 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 21:00:28,620 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840428620"}]},"ts":"1676840428620"} 2023-02-19 21:00:28,622 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-19 21:00:28,624 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 21:00:28,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 540 msec 2023-02-19 21:00:28,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:28,692 INFO [Listener at localhost/36919] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-19 21:00:28,692 DEBUG [Listener at localhost/36919] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-19 21:00:28,693 INFO [Listener at localhost/36919] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 21:00:28,695 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-19 21:00:28,695 INFO [Listener at localhost/36919] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 21:00:28,696 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-19 21:00:28,696 INFO [Listener at localhost/36919] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 21:00:28,731 DEBUG [hconnection-0x2895cb46-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:28,738 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36869] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:28,741 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45092, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:28,747 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36745] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:28,814 INFO [Listener at localhost/36919] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 21:00:28,814 INFO [Listener at localhost/36919] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 21:00:28,815 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-19 21:00:28,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676840428815 (current time:1676840428815). 2023-02-19 21:00:28,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 21:00:28,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] zookeeper.ReadOnlyZKClient(139): Connect 0x5d310481 to 127.0.0.1:61237 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:28,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@583bb3d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:28,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:28,825 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56960, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:28,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d310481 to 127.0.0.1:61237 2023-02-19 21:00:28,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:28,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 21:00:28,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-19 21:00:28,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-19 21:00:28,830 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-19 21:00:28,830 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676841028830 2023-02-19 21:00:28,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-19 21:00:28,831 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,837 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:28,838 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 21:00:28,838 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-19 21:00:28,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-19 21:00:28,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 10 msec 2023-02-19 21:00:28,844 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-19 21:00:28,845 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676841028845 2023-02-19 21:00:28,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,868 INFO [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-19 21:00:28,868 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:28,869 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-19 21:00:28,869 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-19 21:00:28,869 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,870 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,872 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:28,872 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:28,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:28,872 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:28,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:28,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:28,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,873 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,873 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,874 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-19 21:00:28,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,874 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:28,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,874 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-19 21:00:28,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-19 21:00:28,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,875 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-19 21:00:28,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,875 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-19 21:00:28,875 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:28,875 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-19 21:00:28,875 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:28,877 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 21:00:28,877 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-19 21:00:28,877 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 21:00:28,878 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-19 21:00:28,878 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36869,1676840426520' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-19 21:00:28,877 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36745,1676840426551' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-19 21:00:28,879 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,879 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,879 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:28,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:28,879 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,879 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,880 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:28,880 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:28,880 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:28,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:28,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:28,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36869,1676840426520' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-19 21:00:28,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78961b8d[Count = 1] remaining members to acquire global barrier 2023-02-19 21:00:28,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:28,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:28,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:28,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:28,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:28,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36745,1676840426551' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-19 21:00:28,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78961b8d[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:28,883 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-19 21:00:28,883 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,884 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,884 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,885 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:28,885 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 21:00:28,885 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 21:00:28,885 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:28,885 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:28,885 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:28,885 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:28,885 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. started... 2023-02-19 21:00:28,885 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 21:00:28,885 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 21:00:28,891 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 581011ef8f897547ce6fb68ba1815867 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 21:00:28,891 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 21:00:28,891 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 21:00:28,885 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:28,885 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. started... 2023-02-19 21:00:28,891 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. started... 2023-02-19 21:00:28,891 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:28,892 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2db049a65e6635565eed2533a67d8159 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 21:00:28,891 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:28,892 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. started... 2023-02-19 21:00:28,891 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:28,893 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. started... 2023-02-19 21:00:28,893 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 91f9ad61a692d88a30724ae1b9195d5b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 21:00:28,892 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. started... 2023-02-19 21:00:28,892 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 6dff99fe8df12a16cd3ae0a3e51bb836 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 21:00:28,894 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 8a5bb8caaca1c08f803feb67df12422b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 21:00:28,896 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 0e78d795577e0972a2dde19200bbbe18: 2023-02-19 21:00:28,896 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:28,897 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:28,897 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 21:00:28,897 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 21:00:28,926 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/.tmp/f1/28b7d2b184214936bfb734d7338b675d 2023-02-19 21:00:28,938 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:28,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 21:00:28,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 21:00:28,940 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 21:00:28,953 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/.tmp/f1/5c86935aede743a78d844befacdff3f7 2023-02-19 21:00:28,954 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. completed. 2023-02-19 21:00:28,954 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:28,954 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:28,954 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 21:00:28,954 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. started... 2023-02-19 21:00:28,961 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 7759deae7bf8c2f4262d7d3aa6c6ae17 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 21:00:28,962 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/.tmp/f1/e63dfa0fe98d4c479b891a6620057739 2023-02-19 21:00:28,964 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/.tmp/f1/c0505e5ac2ff462c88980f37ece00922 2023-02-19 21:00:28,966 WARN [DataStreamer for file /user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/.tmp/f1/71dc07896a794b7596ae28d71054579c] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-19 21:00:28,966 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/.tmp/f1/71dc07896a794b7596ae28d71054579c 2023-02-19 21:00:28,967 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/.tmp/f2/de522e51562440eeaddad5ffdf94e4cf 2023-02-19 21:00:28,982 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/.tmp/f1/28b7d2b184214936bfb734d7338b675d as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1/28b7d2b184214936bfb734d7338b675d 2023-02-19 21:00:28,987 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1/28b7d2b184214936bfb734d7338b675d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 21:00:28,988 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/.tmp/f2/de522e51562440eeaddad5ffdf94e4cf as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2/de522e51562440eeaddad5ffdf94e4cf 2023-02-19 21:00:29,011 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/.tmp/f1/110c86e26a35483eab4907a52271d837 2023-02-19 21:00:29,033 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/.tmp/f2/04d445a8e6bd42fea0b95b10cd727b1c 2023-02-19 21:00:29,036 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2/de522e51562440eeaddad5ffdf94e4cf, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 21:00:29,037 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 2db049a65e6635565eed2533a67d8159 in 145ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:29,037 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-19 21:00:29,038 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2db049a65e6635565eed2533a67d8159: 2023-02-19 21:00:29,038 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,044 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/.tmp/f1/71dc07896a794b7596ae28d71054579c as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1/71dc07896a794b7596ae28d71054579c 2023-02-19 21:00:29,045 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/.tmp/f2/0b6bae875d3e47068bc8aa3c1bafb614 2023-02-19 21:00:29,045 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/.tmp/f2/78158f9ba66148079c80c721789f8665 2023-02-19 21:00:29,047 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:29,047 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1/28b7d2b184214936bfb734d7338b675d] hfiles 2023-02-19 21:00:29,047 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1/28b7d2b184214936bfb734d7338b675d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,047 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2/de522e51562440eeaddad5ffdf94e4cf] hfiles 2023-02-19 21:00:29,047 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2/de522e51562440eeaddad5ffdf94e4cf for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,059 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/.tmp/f1/5c86935aede743a78d844befacdff3f7 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1/5c86935aede743a78d844befacdff3f7 2023-02-19 21:00:29,061 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/.tmp/f2/35bbcf7d16b34e84b86d5b50cbc6d2ce 2023-02-19 21:00:29,062 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1/71dc07896a794b7596ae28d71054579c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:29,063 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/.tmp/f1/c0505e5ac2ff462c88980f37ece00922 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1/c0505e5ac2ff462c88980f37ece00922 2023-02-19 21:00:29,063 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/.tmp/f2/04d445a8e6bd42fea0b95b10cd727b1c as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2/04d445a8e6bd42fea0b95b10cd727b1c 2023-02-19 21:00:29,066 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1/5c86935aede743a78d844befacdff3f7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:29,067 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/.tmp/f2/78158f9ba66148079c80c721789f8665 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2/78158f9ba66148079c80c721789f8665 2023-02-19 21:00:29,069 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/.tmp/f1/e63dfa0fe98d4c479b891a6620057739 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1/e63dfa0fe98d4c479b891a6620057739 2023-02-19 21:00:29,073 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2/78158f9ba66148079c80c721789f8665, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:29,075 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8a5bb8caaca1c08f803feb67df12422b in 181ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:29,077 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1/e63dfa0fe98d4c479b891a6620057739, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:29,078 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/.tmp/f2/35bbcf7d16b34e84b86d5b50cbc6d2ce as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2/35bbcf7d16b34e84b86d5b50cbc6d2ce 2023-02-19 21:00:29,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 8a5bb8caaca1c08f803feb67df12422b: 2023-02-19 21:00:29,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:29,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1/5c86935aede743a78d844befacdff3f7] hfiles 2023-02-19 21:00:29,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1/5c86935aede743a78d844befacdff3f7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2/78158f9ba66148079c80c721789f8665] hfiles 2023-02-19 21:00:29,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2/78158f9ba66148079c80c721789f8665 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,090 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1/c0505e5ac2ff462c88980f37ece00922, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:29,091 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/.tmp/f2/0b6bae875d3e47068bc8aa3c1bafb614 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2/0b6bae875d3e47068bc8aa3c1bafb614 2023-02-19 21:00:29,123 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2/35bbcf7d16b34e84b86d5b50cbc6d2ce, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:29,124 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. completed. 2023-02-19 21:00:29,124 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:29,124 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:29,124 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 21:00:29,124 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. started... 2023-02-19 21:00:29,124 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6dff99fe8df12a16cd3ae0a3e51bb836 in 232ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:29,125 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 6dff99fe8df12a16cd3ae0a3e51bb836: 2023-02-19 21:00:29,125 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,125 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:29,125 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1/e63dfa0fe98d4c479b891a6620057739] hfiles 2023-02-19 21:00:29,125 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1/e63dfa0fe98d4c479b891a6620057739 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,125 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2/35bbcf7d16b34e84b86d5b50cbc6d2ce] hfiles 2023-02-19 21:00:29,125 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2/35bbcf7d16b34e84b86d5b50cbc6d2ce for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,126 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2/0b6bae875d3e47068bc8aa3c1bafb614, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:29,127 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 91f9ad61a692d88a30724ae1b9195d5b in 233ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:29,127 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 91f9ad61a692d88a30724ae1b9195d5b: 2023-02-19 21:00:29,127 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,127 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:29,127 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1/c0505e5ac2ff462c88980f37ece00922] hfiles 2023-02-19 21:00:29,127 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1/c0505e5ac2ff462c88980f37ece00922 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,127 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2/0b6bae875d3e47068bc8aa3c1bafb614] hfiles 2023-02-19 21:00:29,127 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2/0b6bae875d3e47068bc8aa3c1bafb614 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,129 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2/04d445a8e6bd42fea0b95b10cd727b1c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:29,130 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 581011ef8f897547ce6fb68ba1815867 in 239ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:29,130 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 581011ef8f897547ce6fb68ba1815867: 2023-02-19 21:00:29,130 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,130 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:29,130 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1/71dc07896a794b7596ae28d71054579c] hfiles 2023-02-19 21:00:29,130 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1/71dc07896a794b7596ae28d71054579c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,130 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2/04d445a8e6bd42fea0b95b10cd727b1c] hfiles 2023-02-19 21:00:29,130 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2/04d445a8e6bd42fea0b95b10cd727b1c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,136 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 8527eef6fdb813a46ca9c74a5f40417f 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 21:00:29,137 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/.tmp/f2/ec55c181c96049809086fff7641df80b 2023-02-19 21:00:29,140 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:29,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 21:00:29,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 21:00:29,142 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-19 21:00:29,158 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. completed. 2023-02-19 21:00:29,158 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:29,158 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:29,158 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 21:00:29,158 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. started... 2023-02-19 21:00:29,159 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. completed. 2023-02-19 21:00:29,159 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:29,159 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:29,159 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. started... 2023-02-19 21:00:29,159 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 21:00:29,159 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/.tmp/f1/110c86e26a35483eab4907a52271d837 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1/110c86e26a35483eab4907a52271d837 2023-02-19 21:00:29,164 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c0388ad808943de6c7dc2df52080a97c: 2023-02-19 21:00:29,164 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e2168e49d07e10a19fc572df72cf50bd 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 21:00:29,164 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,164 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:29,164 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 21:00:29,165 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 21:00:29,170 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. completed. 2023-02-19 21:00:29,170 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:29,170 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 21:00:29,170 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1/110c86e26a35483eab4907a52271d837, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:29,171 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/.tmp/f2/ec55c181c96049809086fff7641df80b as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2/ec55c181c96049809086fff7641df80b 2023-02-19 21:00:29,172 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. completed. 2023-02-19 21:00:29,172 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:29,172 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 21:00:29,173 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/.tmp/f1/13489289efbf423c80ebe892103c7d00 2023-02-19 21:00:29,176 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2/ec55c181c96049809086fff7641df80b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:29,177 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7759deae7bf8c2f4262d7d3aa6c6ae17 in 216ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:29,177 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 7759deae7bf8c2f4262d7d3aa6c6ae17: 2023-02-19 21:00:29,177 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,177 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:29,177 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1/110c86e26a35483eab4907a52271d837] hfiles 2023-02-19 21:00:29,177 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1/110c86e26a35483eab4907a52271d837 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,178 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2/ec55c181c96049809086fff7641df80b] hfiles 2023-02-19 21:00:29,178 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2/ec55c181c96049809086fff7641df80b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,180 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. completed. 2023-02-19 21:00:29,180 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:29,180 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 21:00:29,183 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/.tmp/f1/080b470674ca419fa8ad4c3d78c8bf88 2023-02-19 21:00:29,190 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. completed. 2023-02-19 21:00:29,190 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:29,190 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 21:00:29,190 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 21:00:29,190 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,190 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-19 21:00:29,190 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36869,1676840426520' in zk 2023-02-19 21:00:29,192 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,192 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-19 21:00:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:29,192 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:29,192 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-19 21:00:29,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:29,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:29,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:29,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36869,1676840426520': 2023-02-19 21:00:29,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36869,1676840426520' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-19 21:00:29,206 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/.tmp/f2/5c1183bb138f4693bcc13968deb36ea9 2023-02-19 21:00:29,210 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/.tmp/f1/080b470674ca419fa8ad4c3d78c8bf88 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1/080b470674ca419fa8ad4c3d78c8bf88 2023-02-19 21:00:29,214 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1/080b470674ca419fa8ad4c3d78c8bf88, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:29,214 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/.tmp/f2/5c1183bb138f4693bcc13968deb36ea9 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2/5c1183bb138f4693bcc13968deb36ea9 2023-02-19 21:00:29,218 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2/5c1183bb138f4693bcc13968deb36ea9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 21:00:29,218 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e2168e49d07e10a19fc572df72cf50bd in 54ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:29,218 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e2168e49d07e10a19fc572df72cf50bd: 2023-02-19 21:00:29,219 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,219 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:29,219 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1/080b470674ca419fa8ad4c3d78c8bf88] hfiles 2023-02-19 21:00:29,219 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1/080b470674ca419fa8ad4c3d78c8bf88 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,219 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2/5c1183bb138f4693bcc13968deb36ea9] hfiles 2023-02-19 21:00:29,219 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2/5c1183bb138f4693bcc13968deb36ea9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,224 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. completed. 2023-02-19 21:00:29,224 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:29,224 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 21:00:29,442 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:29,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 21:00:29,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 21:00:29,446 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-19 21:00:29,592 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/.tmp/f2/1df3e69d77764c589a7aae8a498be6b0 2023-02-19 21:00:29,597 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/.tmp/f1/13489289efbf423c80ebe892103c7d00 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1/13489289efbf423c80ebe892103c7d00 2023-02-19 21:00:29,601 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1/13489289efbf423c80ebe892103c7d00, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 21:00:29,602 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/.tmp/f2/1df3e69d77764c589a7aae8a498be6b0 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2/1df3e69d77764c589a7aae8a498be6b0 2023-02-19 21:00:29,606 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2/1df3e69d77764c589a7aae8a498be6b0, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 21:00:29,607 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 8527eef6fdb813a46ca9c74a5f40417f in 471ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:29,607 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8527eef6fdb813a46ca9c74a5f40417f: 2023-02-19 21:00:29,607 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,607 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:29,607 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1/13489289efbf423c80ebe892103c7d00] hfiles 2023-02-19 21:00:29,607 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1/13489289efbf423c80ebe892103c7d00 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,607 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2/1df3e69d77764c589a7aae8a498be6b0] hfiles 2023-02-19 21:00:29,607 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2/1df3e69d77764c589a7aae8a498be6b0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,613 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. completed. 2023-02-19 21:00:29,613 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:29,613 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 21:00:29,613 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 21:00:29,613 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:29,613 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-19 21:00:29,613 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36745,1676840426551' in zk 2023-02-19 21:00:29,616 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-19 21:00:29,616 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:29,616 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:29,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:29,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:29,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:29,616 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-19 21:00:29,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:29,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:29,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:29,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:29,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:29,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36745,1676840426551': 2023-02-19 21:00:29,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36745,1676840426551' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-19 21:00:29,619 INFO [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-19 21:00:29,619 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:29,619 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:29,619 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,619 INFO [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 21:00:29,621 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,621 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,621 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:29,621 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,621 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:29,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:29,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:29,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:29,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:29,622 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,622 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:29,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:29,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:29,624 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,624 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:29,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:29,632 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:29,632 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,632 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:29,632 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,633 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:29,632 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:29,633 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:29,633 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:29,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:29,633 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:29,633 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:29,633 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:29,633 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:29,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,633 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:29,633 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:29,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:29,946 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:29,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 21:00:29,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 21:00:29,947 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-19 21:00:30,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:30,087 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-19 21:00:30,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:30,087 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:30,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676840428831Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676840429633 (+802 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676840429633Writing data manifest for testWithMockedMapReduceMultiRegion at 1676840429642 (+9 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676840430055 (+413 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676840430087 (+32 ms) 2023-02-19 21:00:30,089 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-19 21:00:30,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 1.2530 sec 2023-02-19 21:00:30,948 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:30,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 21:00:30,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 21:00:30,949 INFO [Listener at localhost/36919] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 21:00:30,954 INFO [Listener at localhost/36919] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 21:00:30,962 INFO [Listener at localhost/36919] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 21:00:30,987 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36869] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:30,996 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36745] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:31,053 INFO [Listener at localhost/36919] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 21:00:31,061 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 21:00:31,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,064 INFO [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-19 21:00:31,064 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:31,066 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-19 21:00:31,066 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-19 21:00:31,066 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,067 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,069 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:31,069 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:31,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:31,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:31,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:31,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,070 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,071 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,071 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,071 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,071 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,072 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,072 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:31,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,079 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-19 21:00:31,079 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:31,079 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-19 21:00:31,080 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 21:00:31,080 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:31,081 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 21:00:31,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:31,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. started... 2023-02-19 21:00:31,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:31,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. started... 2023-02-19 21:00:31,081 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:31,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:31,081 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. started... 2023-02-19 21:00:31,081 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2db049a65e6635565eed2533a67d8159 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 21:00:31,081 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:31,081 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. started... 2023-02-19 21:00:31,081 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 21:00:31,082 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 21:00:31,082 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0e78d795577e0972a2dde19200bbbe18: 2023-02-19 21:00:31,082 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:31,082 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:31,082 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. started... 2023-02-19 21:00:31,082 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7759deae7bf8c2f4262d7d3aa6c6ae17 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:31,081 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 581011ef8f897547ce6fb68ba1815867 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:31,081 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 21:00:31,082 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 21:00:31,081 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:31,082 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 21:00:31,081 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. started... 2023-02-19 21:00:31,081 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6dff99fe8df12a16cd3ae0a3e51bb836 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:31,082 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. started... 2023-02-19 21:00:31,083 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8a5bb8caaca1c08f803feb67df12422b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:31,083 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 91f9ad61a692d88a30724ae1b9195d5b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:31,099 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/.tmp/f1/75455f7548084e608de535e656bbaae4 2023-02-19 21:00:31,100 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/.tmp/f1/0aacc30393f54313a7c3a1ff4eae6384 2023-02-19 21:00:31,103 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/.tmp/f1/4d140607b2c941b2a90acddcb1480451 2023-02-19 21:00:31,108 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/.tmp/f1/858f1001100b4600ab462f257226195c 2023-02-19 21:00:31,109 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/.tmp/f1/0e359e9ef126451e93ef0a0c74d22b6e 2023-02-19 21:00:31,135 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/.tmp/f2/3faaa2afd4e54de9a5125e7b9184830a 2023-02-19 21:00:31,138 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/.tmp/f2/32fed20b2e2a4295bcc975e56b12c1a5 2023-02-19 21:00:31,139 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/.tmp/f2/b557ec95769f4f03b792daf3ef32694d 2023-02-19 21:00:31,141 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/.tmp/f2/cc3d4876ad5d483ab89a6a56dddac9ee 2023-02-19 21:00:31,141 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/.tmp/f2/64fe155f7e16435f8da6de063758b01a 2023-02-19 21:00:31,143 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/.tmp/f1/0aacc30393f54313a7c3a1ff4eae6384 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1/0aacc30393f54313a7c3a1ff4eae6384 2023-02-19 21:00:31,145 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/.tmp/f1/858f1001100b4600ab462f257226195c as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1/858f1001100b4600ab462f257226195c 2023-02-19 21:00:31,147 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/.tmp/f1/0e359e9ef126451e93ef0a0c74d22b6e as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1/0e359e9ef126451e93ef0a0c74d22b6e 2023-02-19 21:00:31,149 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/.tmp/f1/4d140607b2c941b2a90acddcb1480451 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1/4d140607b2c941b2a90acddcb1480451 2023-02-19 21:00:31,149 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/.tmp/f1/75455f7548084e608de535e656bbaae4 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1/75455f7548084e608de535e656bbaae4 2023-02-19 21:00:31,149 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1/0aacc30393f54313a7c3a1ff4eae6384, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 21:00:31,151 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/.tmp/f2/3faaa2afd4e54de9a5125e7b9184830a as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2/3faaa2afd4e54de9a5125e7b9184830a 2023-02-19 21:00:31,152 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1/858f1001100b4600ab462f257226195c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:31,152 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1/0e359e9ef126451e93ef0a0c74d22b6e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:31,153 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/.tmp/f2/32fed20b2e2a4295bcc975e56b12c1a5 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2/32fed20b2e2a4295bcc975e56b12c1a5 2023-02-19 21:00:31,153 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/.tmp/f2/b557ec95769f4f03b792daf3ef32694d as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2/b557ec95769f4f03b792daf3ef32694d 2023-02-19 21:00:31,154 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1/75455f7548084e608de535e656bbaae4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:31,154 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1/4d140607b2c941b2a90acddcb1480451, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:31,155 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/.tmp/f2/64fe155f7e16435f8da6de063758b01a as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2/64fe155f7e16435f8da6de063758b01a 2023-02-19 21:00:31,155 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/.tmp/f2/cc3d4876ad5d483ab89a6a56dddac9ee as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2/cc3d4876ad5d483ab89a6a56dddac9ee 2023-02-19 21:00:31,157 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2/3faaa2afd4e54de9a5125e7b9184830a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 21:00:31,158 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 2db049a65e6635565eed2533a67d8159 in 77ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:31,158 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2db049a65e6635565eed2533a67d8159: 2023-02-19 21:00:31,158 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:31,158 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:31,158 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. started... 2023-02-19 21:00:31,158 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 21:00:31,158 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8527eef6fdb813a46ca9c74a5f40417f 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 21:00:31,159 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2/32fed20b2e2a4295bcc975e56b12c1a5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:31,160 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2/b557ec95769f4f03b792daf3ef32694d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:31,161 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8a5bb8caaca1c08f803feb67df12422b in 78ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:31,161 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8a5bb8caaca1c08f803feb67df12422b: 2023-02-19 21:00:31,161 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:31,161 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:31,161 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 21:00:31,161 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. started... 2023-02-19 21:00:31,161 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7759deae7bf8c2f4262d7d3aa6c6ae17 in 79ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:31,161 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e2168e49d07e10a19fc572df72cf50bd 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 21:00:31,161 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7759deae7bf8c2f4262d7d3aa6c6ae17: 2023-02-19 21:00:31,161 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:31,161 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:31,161 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 21:00:31,161 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. started... 2023-02-19 21:00:31,161 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c0388ad808943de6c7dc2df52080a97c: 2023-02-19 21:00:31,161 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:31,161 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 21:00:31,164 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2/64fe155f7e16435f8da6de063758b01a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:31,164 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6dff99fe8df12a16cd3ae0a3e51bb836 in 83ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:31,164 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6dff99fe8df12a16cd3ae0a3e51bb836: 2023-02-19 21:00:31,164 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:31,164 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 21:00:31,169 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2/cc3d4876ad5d483ab89a6a56dddac9ee, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:31,169 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 581011ef8f897547ce6fb68ba1815867 in 88ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:31,169 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 581011ef8f897547ce6fb68ba1815867: 2023-02-19 21:00:31,169 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:31,169 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 21:00:31,180 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/.tmp/f1/bd852a4571d84a519d89d2bfb08b3cfd 2023-02-19 21:00:31,185 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/.tmp/f1/84c677e5f1424c00b8d72b1cc7a9a93b 2023-02-19 21:00:31,191 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/.tmp/f2/9f1dfc2ca7804dae9617f6fba4071f47 2023-02-19 21:00:31,196 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/.tmp/f1/bd852a4571d84a519d89d2bfb08b3cfd as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1/bd852a4571d84a519d89d2bfb08b3cfd 2023-02-19 21:00:31,196 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/.tmp/f2/76a69fb454dc4a5583b9e90a78435ee1 2023-02-19 21:00:31,200 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1/bd852a4571d84a519d89d2bfb08b3cfd, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 21:00:31,200 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/.tmp/f1/84c677e5f1424c00b8d72b1cc7a9a93b as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1/84c677e5f1424c00b8d72b1cc7a9a93b 2023-02-19 21:00:31,200 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/.tmp/f2/9f1dfc2ca7804dae9617f6fba4071f47 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2/9f1dfc2ca7804dae9617f6fba4071f47 2023-02-19 21:00:31,205 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1/84c677e5f1424c00b8d72b1cc7a9a93b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:31,205 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/.tmp/f2/76a69fb454dc4a5583b9e90a78435ee1 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2/76a69fb454dc4a5583b9e90a78435ee1 2023-02-19 21:00:31,205 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2/9f1dfc2ca7804dae9617f6fba4071f47, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 21:00:31,206 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 8527eef6fdb813a46ca9c74a5f40417f in 48ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:31,207 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8527eef6fdb813a46ca9c74a5f40417f: 2023-02-19 21:00:31,207 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 21:00:31,215 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2/76a69fb454dc4a5583b9e90a78435ee1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:31,216 INFO [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e2168e49d07e10a19fc572df72cf50bd in 55ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:31,216 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e2168e49d07e10a19fc572df72cf50bd: 2023-02-19 21:00:31,216 DEBUG [rs(jenkins-hbase4.apache.org,36745,1676840426551)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:31,216 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 21:00:31,216 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 21:00:31,216 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,216 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-19 21:00:31,216 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36745,1676840426551' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-19 21:00:31,218 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,218 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:31,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:31,219 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,219 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:31,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:31,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:31,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:31,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36745,1676840426551' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-19 21:00:31,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ca99047[Count = 1] remaining members to acquire global barrier 2023-02-19 21:00:31,449 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 21:00:31,449 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-19 21:00:31,504 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/.tmp/f1/6a65387d44bb4801b4e2539717d892d0 2023-02-19 21:00:31,521 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/.tmp/f2/f7c3c1d967a94809aadf1b77de996edc 2023-02-19 21:00:31,525 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/.tmp/f1/6a65387d44bb4801b4e2539717d892d0 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1/6a65387d44bb4801b4e2539717d892d0 2023-02-19 21:00:31,529 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1/6a65387d44bb4801b4e2539717d892d0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:31,530 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/.tmp/f2/f7c3c1d967a94809aadf1b77de996edc as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2/f7c3c1d967a94809aadf1b77de996edc 2023-02-19 21:00:31,533 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2/f7c3c1d967a94809aadf1b77de996edc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 21:00:31,534 INFO [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 91f9ad61a692d88a30724ae1b9195d5b in 451ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:31,534 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 91f9ad61a692d88a30724ae1b9195d5b: 2023-02-19 21:00:31,534 DEBUG [rs(jenkins-hbase4.apache.org,36869,1676840426520)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:31,534 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 21:00:31,534 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 21:00:31,534 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,534 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-19 21:00:31,534 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36869,1676840426520' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-19 21:00:31,536 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,536 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:31,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:31,536 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,536 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:31,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:31,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36869,1676840426520' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-19 21:00:31,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ca99047[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:31,538 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-19 21:00:31,538 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,539 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,539 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 21:00:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-19 21:00:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 21:00:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-19 21:00:31,539 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36745,1676840426551' in zk 2023-02-19 21:00:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36869,1676840426520' in zk 2023-02-19 21:00:31,540 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,540 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:31,542 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-19 21:00:31,542 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,542 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:31,542 DEBUG [member: 'jenkins-hbase4.apache.org,36745,1676840426551' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-19 21:00:31,543 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,543 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-19 21:00:31,543 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:31,543 DEBUG [member: 'jenkins-hbase4.apache.org,36869,1676840426520' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-19 21:00:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36745,1676840426551': 2023-02-19 21:00:31,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36745,1676840426551' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-19 21:00:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36869,1676840426520': 2023-02-19 21:00:31,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36869,1676840426520' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-19 21:00:31,548 INFO [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-19 21:00:31,548 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:31,548 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:31,548 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,548 INFO [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 21:00:31,550 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,550 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,550 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:31,550 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:31,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,550 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:31,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:31,587 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:31,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:31,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:31,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:31,589 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:31,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,590 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,591 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:31,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,593 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:31,593 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:31,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:31,593 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:31,594 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-19 21:00:31,594 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 21:00:31,594 DEBUG [(jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:31,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:31,593 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:31,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:31,593 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:31,594 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,594 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,594 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,594 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:31,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:31,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:31,594 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:31,594 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 21:00:31,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:31,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:31,594 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,595 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:31,595 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,595 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,694 DEBUG [Listener at localhost/36919] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 21:00:31,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 21:00:31,701 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676840428815 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:31,701 DEBUG [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,701 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(239): region to add: 2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(239): region to add: 581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(239): region to add: 91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(239): region to add: 6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(239): region to add: 0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(239): region to add: 8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(239): region to add: 8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(239): region to add: 7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(239): region to add: c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(239): region to add: e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(585): clone region=2db049a65e6635565eed2533a67d8159 as 2db049a65e6635565eed2533a67d8159 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(585): clone region=581011ef8f897547ce6fb68ba1815867 as 581011ef8f897547ce6fb68ba1815867 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(585): clone region=91f9ad61a692d88a30724ae1b9195d5b as 91f9ad61a692d88a30724ae1b9195d5b in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(585): clone region=6dff99fe8df12a16cd3ae0a3e51bb836 as 6dff99fe8df12a16cd3ae0a3e51bb836 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(585): clone region=0e78d795577e0972a2dde19200bbbe18 as 0e78d795577e0972a2dde19200bbbe18 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(585): clone region=8a5bb8caaca1c08f803feb67df12422b as 8a5bb8caaca1c08f803feb67df12422b in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(585): clone region=8527eef6fdb813a46ca9c74a5f40417f as 8527eef6fdb813a46ca9c74a5f40417f in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(585): clone region=7759deae7bf8c2f4262d7d3aa6c6ae17 as 7759deae7bf8c2f4262d7d3aa6c6ae17 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(585): clone region=c0388ad808943de6c7dc2df52080a97c as c0388ad808943de6c7dc2df52080a97c in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,702 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(585): clone region=e2168e49d07e10a19fc572df72cf50bd as e2168e49d07e10a19fc572df72cf50bd in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,703 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2db049a65e6635565eed2533a67d8159, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14 2023-02-19 21:00:31,704 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 581011ef8f897547ce6fb68ba1815867, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14 2023-02-19 21:00:31,707 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 91f9ad61a692d88a30724ae1b9195d5b, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14 2023-02-19 21:00:31,716 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 6dff99fe8df12a16cd3ae0a3e51bb836, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14 2023-02-19 21:00:31,717 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 0e78d795577e0972a2dde19200bbbe18, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14 2023-02-19 21:00:31,719 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 7759deae7bf8c2f4262d7d3aa6c6ae17, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14 2023-02-19 21:00:31,732 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 8a5bb8caaca1c08f803feb67df12422b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14 2023-02-19 21:00:31,732 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 8527eef6fdb813a46ca9c74a5f40417f, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14 2023-02-19 21:00:31,739 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:31,739 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 28b7d2b184214936bfb734d7338b675d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,769 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink de522e51562440eeaddad5ffdf94e4cf from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,769 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:31,769 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e63dfa0fe98d4c479b891a6620057739 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,770 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:31,771 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 71dc07896a794b7596ae28d71054579c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,776 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 35bbcf7d16b34e84b86d5b50cbc6d2ce from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,792 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 6dff99fe8df12a16cd3ae0a3e51bb836, disabling compactions & flushes 2023-02-19 21:00:31,792 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 2db049a65e6635565eed2533a67d8159, disabling compactions & flushes 2023-02-19 21:00:31,792 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:31,792 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:31,792 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:31,792 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:31,792 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. after waiting 0 ms 2023-02-19 21:00:31,792 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:31,792 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. after waiting 0 ms 2023-02-19 21:00:31,792 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:31,792 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:31,793 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 6dff99fe8df12a16cd3ae0a3e51bb836: 2023-02-19 21:00:31,793 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:31,793 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 2db049a65e6635565eed2533a67d8159: 2023-02-19 21:00:31,793 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => c0388ad808943de6c7dc2df52080a97c, NAME => 'testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14 2023-02-19 21:00:31,793 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e2168e49d07e10a19fc572df72cf50bd, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14 2023-02-19 21:00:31,804 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 04d445a8e6bd42fea0b95b10cd727b1c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,806 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:31,806 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 0e78d795577e0972a2dde19200bbbe18, disabling compactions & flushes 2023-02-19 21:00:31,806 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:31,806 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:31,806 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. after waiting 0 ms 2023-02-19 21:00:31,806 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:31,806 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:31,806 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 0e78d795577e0972a2dde19200bbbe18: 2023-02-19 21:00:31,812 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:31,812 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 110c86e26a35483eab4907a52271d837 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,814 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:31,814 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c0505e5ac2ff462c88980f37ece00922 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,816 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:31,816 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 13489289efbf423c80ebe892103c7d00 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,822 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:31,822 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0b6bae875d3e47068bc8aa3c1bafb614 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,822 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5c86935aede743a78d844befacdff3f7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,822 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 581011ef8f897547ce6fb68ba1815867, disabling compactions & flushes 2023-02-19 21:00:31,822 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:31,822 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:31,822 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. after waiting 0 ms 2023-02-19 21:00:31,822 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:31,822 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:31,823 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 581011ef8f897547ce6fb68ba1815867: 2023-02-19 21:00:31,823 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ec55c181c96049809086fff7641df80b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,823 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1df3e69d77764c589a7aae8a498be6b0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,828 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:31,828 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 080b470674ca419fa8ad4c3d78c8bf88 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,828 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:31,828 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing c0388ad808943de6c7dc2df52080a97c, disabling compactions & flushes 2023-02-19 21:00:31,828 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:31,828 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:31,828 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. after waiting 0 ms 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:31,829 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for c0388ad808943de6c7dc2df52080a97c: 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 91f9ad61a692d88a30724ae1b9195d5b, disabling compactions & flushes 2023-02-19 21:00:31,829 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. after waiting 0 ms 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:31,829 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 7759deae7bf8c2f4262d7d3aa6c6ae17, disabling compactions & flushes 2023-02-19 21:00:31,829 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 78158f9ba66148079c80c721789f8665 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 8527eef6fdb813a46ca9c74a5f40417f, disabling compactions & flushes 2023-02-19 21:00:31,829 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:31,829 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 91f9ad61a692d88a30724ae1b9195d5b: 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. after waiting 0 ms 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. after waiting 0 ms 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:31,829 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:31,829 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:31,830 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 7759deae7bf8c2f4262d7d3aa6c6ae17: 2023-02-19 21:00:31,829 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 8527eef6fdb813a46ca9c74a5f40417f: 2023-02-19 21:00:31,830 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5c1183bb138f4693bcc13968deb36ea9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:31,831 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 8a5bb8caaca1c08f803feb67df12422b, disabling compactions & flushes 2023-02-19 21:00:31,831 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:31,831 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:31,831 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. after waiting 0 ms 2023-02-19 21:00:31,831 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:31,831 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:31,831 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 8a5bb8caaca1c08f803feb67df12422b: 2023-02-19 21:00:31,832 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e2168e49d07e10a19fc572df72cf50bd, disabling compactions & flushes 2023-02-19 21:00:31,832 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:31,832 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:31,832 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. after waiting 0 ms 2023-02-19 21:00:31,832 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:31,832 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:31,832 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e2168e49d07e10a19fc572df72cf50bd: 2023-02-19 21:00:31,832 INFO [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676840428815 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:31,833 DEBUG [Listener at localhost/36919] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14 2023-02-19 21:00:31,833 DEBUG [Listener at localhost/36919] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14 2023-02-19 21:00:31,833 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-data/ 2023-02-19 21:00:31,834 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |----default/ 2023-02-19 21:00:31,834 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-19 21:00:31,834 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |----------0e78d795577e0972a2dde19200bbbe18/ 2023-02-19 21:00:31,835 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:31,835 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |----------2db049a65e6635565eed2533a67d8159/ 2023-02-19 21:00:31,835 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:31,835 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:31,835 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2db049a65e6635565eed2533a67d8159-28b7d2b184214936bfb734d7338b675d 2023-02-19 21:00:31,836 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:31,836 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2db049a65e6635565eed2533a67d8159-de522e51562440eeaddad5ffdf94e4cf 2023-02-19 21:00:31,836 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |----------581011ef8f897547ce6fb68ba1815867/ 2023-02-19 21:00:31,836 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:31,836 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:31,837 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=581011ef8f897547ce6fb68ba1815867-71dc07896a794b7596ae28d71054579c 2023-02-19 21:00:31,837 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:31,837 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=581011ef8f897547ce6fb68ba1815867-04d445a8e6bd42fea0b95b10cd727b1c 2023-02-19 21:00:31,837 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |----------6dff99fe8df12a16cd3ae0a3e51bb836/ 2023-02-19 21:00:31,837 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:31,837 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:31,838 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6dff99fe8df12a16cd3ae0a3e51bb836-e63dfa0fe98d4c479b891a6620057739 2023-02-19 21:00:31,838 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:31,838 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6dff99fe8df12a16cd3ae0a3e51bb836-35bbcf7d16b34e84b86d5b50cbc6d2ce 2023-02-19 21:00:31,838 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |----------7759deae7bf8c2f4262d7d3aa6c6ae17/ 2023-02-19 21:00:31,838 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:31,838 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:31,839 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7759deae7bf8c2f4262d7d3aa6c6ae17-110c86e26a35483eab4907a52271d837 2023-02-19 21:00:31,839 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:31,839 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7759deae7bf8c2f4262d7d3aa6c6ae17-ec55c181c96049809086fff7641df80b 2023-02-19 21:00:31,839 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |----------8527eef6fdb813a46ca9c74a5f40417f/ 2023-02-19 21:00:31,839 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:31,839 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:31,840 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8527eef6fdb813a46ca9c74a5f40417f-13489289efbf423c80ebe892103c7d00 2023-02-19 21:00:31,840 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:31,840 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8527eef6fdb813a46ca9c74a5f40417f-1df3e69d77764c589a7aae8a498be6b0 2023-02-19 21:00:31,840 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |----------8a5bb8caaca1c08f803feb67df12422b/ 2023-02-19 21:00:31,840 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:31,840 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:31,841 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8a5bb8caaca1c08f803feb67df12422b-5c86935aede743a78d844befacdff3f7 2023-02-19 21:00:31,841 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:31,841 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8a5bb8caaca1c08f803feb67df12422b-78158f9ba66148079c80c721789f8665 2023-02-19 21:00:31,841 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |----------91f9ad61a692d88a30724ae1b9195d5b/ 2023-02-19 21:00:31,841 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:31,841 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:31,842 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=91f9ad61a692d88a30724ae1b9195d5b-c0505e5ac2ff462c88980f37ece00922 2023-02-19 21:00:31,842 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:31,842 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=91f9ad61a692d88a30724ae1b9195d5b-0b6bae875d3e47068bc8aa3c1bafb614 2023-02-19 21:00:31,842 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |----------c0388ad808943de6c7dc2df52080a97c/ 2023-02-19 21:00:31,842 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:31,842 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |----------e2168e49d07e10a19fc572df72cf50bd/ 2023-02-19 21:00:31,843 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:31,843 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:31,843 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e2168e49d07e10a19fc572df72cf50bd-080b470674ca419fa8ad4c3d78c8bf88 2023-02-19 21:00:31,843 DEBUG [Listener at localhost/36919] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:31,843 DEBUG [Listener at localhost/36919] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e2168e49d07e10a19fc572df72cf50bd-5c1183bb138f4693bcc13968deb36ea9 2023-02-19 21:00:31,847 INFO [Listener at localhost/36919] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 21:00:32,517 DEBUG [Listener at localhost/36919] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:32,517 INFO [Listener at localhost/36919] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:32,519 DEBUG [Listener at localhost/36919] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:32,521 INFO [StoreOpener-2db049a65e6635565eed2533a67d8159-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:32,523 DEBUG [StoreOpener-2db049a65e6635565eed2533a67d8159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1 2023-02-19 21:00:32,523 INFO [StoreOpener-2db049a65e6635565eed2533a67d8159-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2db049a65e6635565eed2533a67d8159 columnFamilyName f1 2023-02-19 21:00:32,528 DEBUG [StoreOpener-2db049a65e6635565eed2533a67d8159-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1/testWithMockedMapReduceMultiRegion=2db049a65e6635565eed2533a67d8159-28b7d2b184214936bfb734d7338b675d 2023-02-19 21:00:32,528 INFO [StoreOpener-2db049a65e6635565eed2533a67d8159-1] regionserver.HStore(310): Store=2db049a65e6635565eed2533a67d8159/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,528 INFO [StoreOpener-2db049a65e6635565eed2533a67d8159-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:32,529 DEBUG [StoreOpener-2db049a65e6635565eed2533a67d8159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2 2023-02-19 21:00:32,530 INFO [StoreOpener-2db049a65e6635565eed2533a67d8159-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2db049a65e6635565eed2533a67d8159 columnFamilyName f2 2023-02-19 21:00:32,534 DEBUG [StoreOpener-2db049a65e6635565eed2533a67d8159-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2/testWithMockedMapReduceMultiRegion=2db049a65e6635565eed2533a67d8159-de522e51562440eeaddad5ffdf94e4cf 2023-02-19 21:00:32,534 INFO [StoreOpener-2db049a65e6635565eed2533a67d8159-1] regionserver.HStore(310): Store=2db049a65e6635565eed2533a67d8159/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,534 DEBUG [Listener at localhost/36919] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:32,534 INFO [Listener at localhost/36919] regionserver.HRegion(1071): Opened 2db049a65e6635565eed2533a67d8159; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71224487, jitterRate=0.06132756173610687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:32,534 DEBUG [Listener at localhost/36919] regionserver.HRegion(964): Region open journal for 2db049a65e6635565eed2533a67d8159: 2023-02-19 21:00:32,546 DEBUG [Listener at localhost/36919] regionserver.HRegion(1603): Closing 2db049a65e6635565eed2533a67d8159, disabling compactions & flushes 2023-02-19 21:00:32,546 INFO [Listener at localhost/36919] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:32,546 DEBUG [Listener at localhost/36919] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:32,546 DEBUG [Listener at localhost/36919] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. after waiting 0 ms 2023-02-19 21:00:32,546 DEBUG [Listener at localhost/36919] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:32,564 INFO [Listener at localhost/36919] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:32,564 DEBUG [Listener at localhost/36919] regionserver.HRegion(1557): Region close journal for 2db049a65e6635565eed2533a67d8159: 2023-02-19 21:00:32,565 DEBUG [Listener at localhost/36919] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:32,565 INFO [Listener at localhost/36919] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:32,568 DEBUG [Listener at localhost/36919] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:32,573 INFO [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:32,575 DEBUG [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/f1 2023-02-19 21:00:32,575 INFO [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e78d795577e0972a2dde19200bbbe18 columnFamilyName f1 2023-02-19 21:00:32,576 INFO [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] regionserver.HStore(310): Store=0e78d795577e0972a2dde19200bbbe18/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,576 INFO [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:32,577 DEBUG [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/f2 2023-02-19 21:00:32,578 INFO [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e78d795577e0972a2dde19200bbbe18 columnFamilyName f2 2023-02-19 21:00:32,578 INFO [StoreOpener-0e78d795577e0972a2dde19200bbbe18-1] regionserver.HStore(310): Store=0e78d795577e0972a2dde19200bbbe18/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,578 DEBUG [Listener at localhost/36919] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:32,579 INFO [Listener at localhost/36919] regionserver.HRegion(1071): Opened 0e78d795577e0972a2dde19200bbbe18; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67035024, jitterRate=-0.001100301742553711}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:32,579 DEBUG [Listener at localhost/36919] regionserver.HRegion(964): Region open journal for 0e78d795577e0972a2dde19200bbbe18: 2023-02-19 21:00:32,579 DEBUG [Listener at localhost/36919] regionserver.HRegion(1603): Closing 0e78d795577e0972a2dde19200bbbe18, disabling compactions & flushes 2023-02-19 21:00:32,579 INFO [Listener at localhost/36919] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:32,579 DEBUG [Listener at localhost/36919] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:32,579 DEBUG [Listener at localhost/36919] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. after waiting 0 ms 2023-02-19 21:00:32,579 DEBUG [Listener at localhost/36919] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:32,580 INFO [Listener at localhost/36919] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:32,581 DEBUG [Listener at localhost/36919] regionserver.HRegion(1557): Region close journal for 0e78d795577e0972a2dde19200bbbe18: 2023-02-19 21:00:32,581 DEBUG [Listener at localhost/36919] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:32,582 INFO [Listener at localhost/36919] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:32,600 DEBUG [Listener at localhost/36919] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:32,603 INFO [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:32,604 DEBUG [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1 2023-02-19 21:00:32,604 INFO [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8527eef6fdb813a46ca9c74a5f40417f columnFamilyName f1 2023-02-19 21:00:32,613 DEBUG [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1/testWithMockedMapReduceMultiRegion=8527eef6fdb813a46ca9c74a5f40417f-13489289efbf423c80ebe892103c7d00 2023-02-19 21:00:32,613 INFO [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] regionserver.HStore(310): Store=8527eef6fdb813a46ca9c74a5f40417f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,613 INFO [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:32,615 DEBUG [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2 2023-02-19 21:00:32,616 INFO [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8527eef6fdb813a46ca9c74a5f40417f columnFamilyName f2 2023-02-19 21:00:32,623 DEBUG [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2/testWithMockedMapReduceMultiRegion=8527eef6fdb813a46ca9c74a5f40417f-1df3e69d77764c589a7aae8a498be6b0 2023-02-19 21:00:32,623 INFO [StoreOpener-8527eef6fdb813a46ca9c74a5f40417f-1] regionserver.HStore(310): Store=8527eef6fdb813a46ca9c74a5f40417f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,624 DEBUG [Listener at localhost/36919] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:32,624 INFO [Listener at localhost/36919] regionserver.HRegion(1071): Opened 8527eef6fdb813a46ca9c74a5f40417f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72742107, jitterRate=0.08394186198711395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:32,624 DEBUG [Listener at localhost/36919] regionserver.HRegion(964): Region open journal for 8527eef6fdb813a46ca9c74a5f40417f: 2023-02-19 21:00:32,639 DEBUG [Listener at localhost/36919] regionserver.HRegion(1603): Closing 8527eef6fdb813a46ca9c74a5f40417f, disabling compactions & flushes 2023-02-19 21:00:32,639 INFO [Listener at localhost/36919] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:32,639 DEBUG [Listener at localhost/36919] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:32,639 DEBUG [Listener at localhost/36919] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. after waiting 0 ms 2023-02-19 21:00:32,639 DEBUG [Listener at localhost/36919] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:32,641 INFO [Listener at localhost/36919] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:32,641 DEBUG [Listener at localhost/36919] regionserver.HRegion(1557): Region close journal for 8527eef6fdb813a46ca9c74a5f40417f: 2023-02-19 21:00:32,641 DEBUG [Listener at localhost/36919] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:32,642 INFO [Listener at localhost/36919] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:32,644 DEBUG [Listener at localhost/36919] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:32,651 INFO [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:32,652 DEBUG [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1 2023-02-19 21:00:32,652 INFO [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dff99fe8df12a16cd3ae0a3e51bb836 columnFamilyName f1 2023-02-19 21:00:32,660 DEBUG [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1/testWithMockedMapReduceMultiRegion=6dff99fe8df12a16cd3ae0a3e51bb836-e63dfa0fe98d4c479b891a6620057739 2023-02-19 21:00:32,660 INFO [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] regionserver.HStore(310): Store=6dff99fe8df12a16cd3ae0a3e51bb836/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,660 INFO [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:32,661 DEBUG [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2 2023-02-19 21:00:32,662 INFO [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dff99fe8df12a16cd3ae0a3e51bb836 columnFamilyName f2 2023-02-19 21:00:32,668 DEBUG [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2/testWithMockedMapReduceMultiRegion=6dff99fe8df12a16cd3ae0a3e51bb836-35bbcf7d16b34e84b86d5b50cbc6d2ce 2023-02-19 21:00:32,668 INFO [StoreOpener-6dff99fe8df12a16cd3ae0a3e51bb836-1] regionserver.HStore(310): Store=6dff99fe8df12a16cd3ae0a3e51bb836/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,668 DEBUG [Listener at localhost/36919] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:32,668 INFO [Listener at localhost/36919] regionserver.HRegion(1071): Opened 6dff99fe8df12a16cd3ae0a3e51bb836; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61879282, jitterRate=-0.07792684435844421}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:32,668 DEBUG [Listener at localhost/36919] regionserver.HRegion(964): Region open journal for 6dff99fe8df12a16cd3ae0a3e51bb836: 2023-02-19 21:00:32,681 DEBUG [Listener at localhost/36919] regionserver.HRegion(1603): Closing 6dff99fe8df12a16cd3ae0a3e51bb836, disabling compactions & flushes 2023-02-19 21:00:32,681 INFO [Listener at localhost/36919] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:32,681 DEBUG [Listener at localhost/36919] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:32,681 DEBUG [Listener at localhost/36919] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. after waiting 0 ms 2023-02-19 21:00:32,681 DEBUG [Listener at localhost/36919] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:32,682 INFO [Listener at localhost/36919] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:32,682 DEBUG [Listener at localhost/36919] regionserver.HRegion(1557): Region close journal for 6dff99fe8df12a16cd3ae0a3e51bb836: 2023-02-19 21:00:32,683 DEBUG [Listener at localhost/36919] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:32,683 INFO [Listener at localhost/36919] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:32,685 DEBUG [Listener at localhost/36919] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:32,688 INFO [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:32,689 DEBUG [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1 2023-02-19 21:00:32,689 INFO [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2168e49d07e10a19fc572df72cf50bd columnFamilyName f1 2023-02-19 21:00:32,694 DEBUG [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1/testWithMockedMapReduceMultiRegion=e2168e49d07e10a19fc572df72cf50bd-080b470674ca419fa8ad4c3d78c8bf88 2023-02-19 21:00:32,694 INFO [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] regionserver.HStore(310): Store=e2168e49d07e10a19fc572df72cf50bd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,694 INFO [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:32,695 DEBUG [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2 2023-02-19 21:00:32,696 INFO [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2168e49d07e10a19fc572df72cf50bd columnFamilyName f2 2023-02-19 21:00:32,700 DEBUG [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2/testWithMockedMapReduceMultiRegion=e2168e49d07e10a19fc572df72cf50bd-5c1183bb138f4693bcc13968deb36ea9 2023-02-19 21:00:32,700 INFO [StoreOpener-e2168e49d07e10a19fc572df72cf50bd-1] regionserver.HStore(310): Store=e2168e49d07e10a19fc572df72cf50bd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,700 DEBUG [Listener at localhost/36919] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:32,701 INFO [Listener at localhost/36919] regionserver.HRegion(1071): Opened e2168e49d07e10a19fc572df72cf50bd; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73179153, jitterRate=0.0904543548822403}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:32,701 DEBUG [Listener at localhost/36919] regionserver.HRegion(964): Region open journal for e2168e49d07e10a19fc572df72cf50bd: 2023-02-19 21:00:32,714 DEBUG [Listener at localhost/36919] regionserver.HRegion(1603): Closing e2168e49d07e10a19fc572df72cf50bd, disabling compactions & flushes 2023-02-19 21:00:32,715 INFO [Listener at localhost/36919] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:32,715 DEBUG [Listener at localhost/36919] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:32,715 DEBUG [Listener at localhost/36919] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. after waiting 0 ms 2023-02-19 21:00:32,715 DEBUG [Listener at localhost/36919] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:32,716 INFO [Listener at localhost/36919] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:32,716 DEBUG [Listener at localhost/36919] regionserver.HRegion(1557): Region close journal for e2168e49d07e10a19fc572df72cf50bd: 2023-02-19 21:00:32,717 DEBUG [Listener at localhost/36919] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:32,717 INFO [Listener at localhost/36919] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:32,719 DEBUG [Listener at localhost/36919] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:32,720 INFO [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:32,721 DEBUG [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1 2023-02-19 21:00:32,722 INFO [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 581011ef8f897547ce6fb68ba1815867 columnFamilyName f1 2023-02-19 21:00:32,726 DEBUG [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1/testWithMockedMapReduceMultiRegion=581011ef8f897547ce6fb68ba1815867-71dc07896a794b7596ae28d71054579c 2023-02-19 21:00:32,726 INFO [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] regionserver.HStore(310): Store=581011ef8f897547ce6fb68ba1815867/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,726 INFO [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:32,727 DEBUG [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2 2023-02-19 21:00:32,727 INFO [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 581011ef8f897547ce6fb68ba1815867 columnFamilyName f2 2023-02-19 21:00:32,733 DEBUG [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2/testWithMockedMapReduceMultiRegion=581011ef8f897547ce6fb68ba1815867-04d445a8e6bd42fea0b95b10cd727b1c 2023-02-19 21:00:32,733 INFO [StoreOpener-581011ef8f897547ce6fb68ba1815867-1] regionserver.HStore(310): Store=581011ef8f897547ce6fb68ba1815867/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,734 DEBUG [Listener at localhost/36919] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:32,734 INFO [Listener at localhost/36919] regionserver.HRegion(1071): Opened 581011ef8f897547ce6fb68ba1815867; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69964205, jitterRate=0.04254789650440216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:32,734 DEBUG [Listener at localhost/36919] regionserver.HRegion(964): Region open journal for 581011ef8f897547ce6fb68ba1815867: 2023-02-19 21:00:32,743 DEBUG [Listener at localhost/36919] regionserver.HRegion(1603): Closing 581011ef8f897547ce6fb68ba1815867, disabling compactions & flushes 2023-02-19 21:00:32,743 INFO [Listener at localhost/36919] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:32,743 DEBUG [Listener at localhost/36919] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:32,743 DEBUG [Listener at localhost/36919] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. after waiting 0 ms 2023-02-19 21:00:32,743 DEBUG [Listener at localhost/36919] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:32,744 INFO [Listener at localhost/36919] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:32,744 DEBUG [Listener at localhost/36919] regionserver.HRegion(1557): Region close journal for 581011ef8f897547ce6fb68ba1815867: 2023-02-19 21:00:32,745 DEBUG [Listener at localhost/36919] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:32,745 INFO [Listener at localhost/36919] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:32,747 DEBUG [Listener at localhost/36919] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:32,749 INFO [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:32,750 DEBUG [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1 2023-02-19 21:00:32,750 INFO [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91f9ad61a692d88a30724ae1b9195d5b columnFamilyName f1 2023-02-19 21:00:32,755 DEBUG [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1/testWithMockedMapReduceMultiRegion=91f9ad61a692d88a30724ae1b9195d5b-c0505e5ac2ff462c88980f37ece00922 2023-02-19 21:00:32,755 INFO [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] regionserver.HStore(310): Store=91f9ad61a692d88a30724ae1b9195d5b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,755 INFO [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:32,756 DEBUG [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2 2023-02-19 21:00:32,756 INFO [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91f9ad61a692d88a30724ae1b9195d5b columnFamilyName f2 2023-02-19 21:00:32,764 DEBUG [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2/testWithMockedMapReduceMultiRegion=91f9ad61a692d88a30724ae1b9195d5b-0b6bae875d3e47068bc8aa3c1bafb614 2023-02-19 21:00:32,764 INFO [StoreOpener-91f9ad61a692d88a30724ae1b9195d5b-1] regionserver.HStore(310): Store=91f9ad61a692d88a30724ae1b9195d5b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,764 DEBUG [Listener at localhost/36919] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:32,764 INFO [Listener at localhost/36919] regionserver.HRegion(1071): Opened 91f9ad61a692d88a30724ae1b9195d5b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60304304, jitterRate=-0.10139584541320801}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:32,764 DEBUG [Listener at localhost/36919] regionserver.HRegion(964): Region open journal for 91f9ad61a692d88a30724ae1b9195d5b: 2023-02-19 21:00:32,773 DEBUG [Listener at localhost/36919] regionserver.HRegion(1603): Closing 91f9ad61a692d88a30724ae1b9195d5b, disabling compactions & flushes 2023-02-19 21:00:32,773 INFO [Listener at localhost/36919] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:32,773 DEBUG [Listener at localhost/36919] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:32,773 DEBUG [Listener at localhost/36919] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. after waiting 0 ms 2023-02-19 21:00:32,773 DEBUG [Listener at localhost/36919] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:32,774 INFO [Listener at localhost/36919] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:32,774 DEBUG [Listener at localhost/36919] regionserver.HRegion(1557): Region close journal for 91f9ad61a692d88a30724ae1b9195d5b: 2023-02-19 21:00:32,775 DEBUG [Listener at localhost/36919] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:32,775 INFO [Listener at localhost/36919] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:32,777 DEBUG [Listener at localhost/36919] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:32,779 INFO [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:32,782 DEBUG [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/f1 2023-02-19 21:00:32,782 INFO [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0388ad808943de6c7dc2df52080a97c columnFamilyName f1 2023-02-19 21:00:32,782 INFO [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] regionserver.HStore(310): Store=c0388ad808943de6c7dc2df52080a97c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,783 INFO [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:32,784 DEBUG [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/f2 2023-02-19 21:00:32,784 INFO [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0388ad808943de6c7dc2df52080a97c columnFamilyName f2 2023-02-19 21:00:32,784 INFO [StoreOpener-c0388ad808943de6c7dc2df52080a97c-1] regionserver.HStore(310): Store=c0388ad808943de6c7dc2df52080a97c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,784 DEBUG [Listener at localhost/36919] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:32,785 INFO [Listener at localhost/36919] regionserver.HRegion(1071): Opened c0388ad808943de6c7dc2df52080a97c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61997830, jitterRate=-0.07616034150123596}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:32,785 DEBUG [Listener at localhost/36919] regionserver.HRegion(964): Region open journal for c0388ad808943de6c7dc2df52080a97c: 2023-02-19 21:00:32,785 DEBUG [Listener at localhost/36919] regionserver.HRegion(1603): Closing c0388ad808943de6c7dc2df52080a97c, disabling compactions & flushes 2023-02-19 21:00:32,785 INFO [Listener at localhost/36919] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:32,785 DEBUG [Listener at localhost/36919] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:32,785 DEBUG [Listener at localhost/36919] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. after waiting 0 ms 2023-02-19 21:00:32,785 DEBUG [Listener at localhost/36919] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:32,785 INFO [Listener at localhost/36919] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:32,785 DEBUG [Listener at localhost/36919] regionserver.HRegion(1557): Region close journal for c0388ad808943de6c7dc2df52080a97c: 2023-02-19 21:00:32,786 DEBUG [Listener at localhost/36919] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:32,786 INFO [Listener at localhost/36919] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:32,788 DEBUG [Listener at localhost/36919] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:32,789 INFO [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:32,790 DEBUG [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1 2023-02-19 21:00:32,791 INFO [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a5bb8caaca1c08f803feb67df12422b columnFamilyName f1 2023-02-19 21:00:32,798 DEBUG [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1/testWithMockedMapReduceMultiRegion=8a5bb8caaca1c08f803feb67df12422b-5c86935aede743a78d844befacdff3f7 2023-02-19 21:00:32,798 INFO [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] regionserver.HStore(310): Store=8a5bb8caaca1c08f803feb67df12422b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,798 INFO [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:32,798 DEBUG [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2 2023-02-19 21:00:32,799 INFO [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a5bb8caaca1c08f803feb67df12422b columnFamilyName f2 2023-02-19 21:00:32,802 DEBUG [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2/testWithMockedMapReduceMultiRegion=8a5bb8caaca1c08f803feb67df12422b-78158f9ba66148079c80c721789f8665 2023-02-19 21:00:32,803 INFO [StoreOpener-8a5bb8caaca1c08f803feb67df12422b-1] regionserver.HStore(310): Store=8a5bb8caaca1c08f803feb67df12422b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,803 DEBUG [Listener at localhost/36919] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:32,803 INFO [Listener at localhost/36919] regionserver.HRegion(1071): Opened 8a5bb8caaca1c08f803feb67df12422b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75093830, jitterRate=0.11898526549339294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:32,803 DEBUG [Listener at localhost/36919] regionserver.HRegion(964): Region open journal for 8a5bb8caaca1c08f803feb67df12422b: 2023-02-19 21:00:32,813 DEBUG [Listener at localhost/36919] regionserver.HRegion(1603): Closing 8a5bb8caaca1c08f803feb67df12422b, disabling compactions & flushes 2023-02-19 21:00:32,814 INFO [Listener at localhost/36919] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:32,814 DEBUG [Listener at localhost/36919] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:32,814 DEBUG [Listener at localhost/36919] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. after waiting 0 ms 2023-02-19 21:00:32,814 DEBUG [Listener at localhost/36919] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:32,822 INFO [Listener at localhost/36919] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:32,822 DEBUG [Listener at localhost/36919] regionserver.HRegion(1557): Region close journal for 8a5bb8caaca1c08f803feb67df12422b: 2023-02-19 21:00:32,823 DEBUG [Listener at localhost/36919] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:32,823 INFO [Listener at localhost/36919] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:32,825 DEBUG [Listener at localhost/36919] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:32,828 INFO [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:32,829 DEBUG [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1 2023-02-19 21:00:32,829 INFO [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7759deae7bf8c2f4262d7d3aa6c6ae17 columnFamilyName f1 2023-02-19 21:00:32,833 DEBUG [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1/testWithMockedMapReduceMultiRegion=7759deae7bf8c2f4262d7d3aa6c6ae17-110c86e26a35483eab4907a52271d837 2023-02-19 21:00:32,833 INFO [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] regionserver.HStore(310): Store=7759deae7bf8c2f4262d7d3aa6c6ae17/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,833 INFO [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:32,834 DEBUG [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2 2023-02-19 21:00:32,835 INFO [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7759deae7bf8c2f4262d7d3aa6c6ae17 columnFamilyName f2 2023-02-19 21:00:32,843 DEBUG [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] regionserver.HStore(539): loaded hdfs://localhost:46315/user/jenkins/test-data/d76c0cc4-4e92-16b9-eb81-865cc3300b00/testWithMockedMapReduceMultiRegion/4a4e6277-577b-4ab1-9820-e6eefeacde14/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2/testWithMockedMapReduceMultiRegion=7759deae7bf8c2f4262d7d3aa6c6ae17-ec55c181c96049809086fff7641df80b 2023-02-19 21:00:32,844 INFO [StoreOpener-7759deae7bf8c2f4262d7d3aa6c6ae17-1] regionserver.HStore(310): Store=7759deae7bf8c2f4262d7d3aa6c6ae17/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:32,844 DEBUG [Listener at localhost/36919] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:32,844 INFO [Listener at localhost/36919] regionserver.HRegion(1071): Opened 7759deae7bf8c2f4262d7d3aa6c6ae17; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67715066, jitterRate=0.009033113718032837}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:32,844 DEBUG [Listener at localhost/36919] regionserver.HRegion(964): Region open journal for 7759deae7bf8c2f4262d7d3aa6c6ae17: 2023-02-19 21:00:32,853 DEBUG [Listener at localhost/36919] regionserver.HRegion(1603): Closing 7759deae7bf8c2f4262d7d3aa6c6ae17, disabling compactions & flushes 2023-02-19 21:00:32,853 INFO [Listener at localhost/36919] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:32,853 DEBUG [Listener at localhost/36919] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:32,853 DEBUG [Listener at localhost/36919] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. after waiting 0 ms 2023-02-19 21:00:32,853 DEBUG [Listener at localhost/36919] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:32,856 INFO [Listener at localhost/36919] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:32,856 DEBUG [Listener at localhost/36919] regionserver.HRegion(1557): Region close journal for 7759deae7bf8c2f4262d7d3aa6c6ae17: 2023-02-19 21:00:32,861 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-19 21:00:32,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-19 21:00:32,865 INFO [Listener at localhost/36919] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-19 21:00:32,866 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-19 21:00:32,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:32,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 21:00:32,869 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840432869"}]},"ts":"1676840432869"} 2023-02-19 21:00:32,871 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-19 21:00:32,872 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-19 21:00:32,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c0388ad808943de6c7dc2df52080a97c, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2db049a65e6635565eed2533a67d8159, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2168e49d07e10a19fc572df72cf50bd, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91f9ad61a692d88a30724ae1b9195d5b, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a5bb8caaca1c08f803feb67df12422b, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=581011ef8f897547ce6fb68ba1815867, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6dff99fe8df12a16cd3ae0a3e51bb836, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7759deae7bf8c2f4262d7d3aa6c6ae17, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8527eef6fdb813a46ca9c74a5f40417f, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0e78d795577e0972a2dde19200bbbe18, UNASSIGN}] 2023-02-19 21:00:32,875 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c0388ad808943de6c7dc2df52080a97c, UNASSIGN 2023-02-19 21:00:32,875 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91f9ad61a692d88a30724ae1b9195d5b, UNASSIGN 2023-02-19 21:00:32,875 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2db049a65e6635565eed2533a67d8159, UNASSIGN 2023-02-19 21:00:32,875 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2168e49d07e10a19fc572df72cf50bd, UNASSIGN 2023-02-19 21:00:32,875 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0e78d795577e0972a2dde19200bbbe18, UNASSIGN 2023-02-19 21:00:32,875 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=c0388ad808943de6c7dc2df52080a97c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:32,876 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=91f9ad61a692d88a30724ae1b9195d5b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:32,876 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=2db049a65e6635565eed2533a67d8159, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:32,876 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676840432875"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840432875"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840432875"}]},"ts":"1676840432875"} 2023-02-19 21:00:32,876 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840432876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840432876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840432876"}]},"ts":"1676840432876"} 2023-02-19 21:00:32,876 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0e78d795577e0972a2dde19200bbbe18, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:32,876 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e2168e49d07e10a19fc572df72cf50bd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:32,876 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840432876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840432876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840432876"}]},"ts":"1676840432876"} 2023-02-19 21:00:32,876 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840432876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840432876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840432876"}]},"ts":"1676840432876"} 2023-02-19 21:00:32,876 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676840432876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840432876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840432876"}]},"ts":"1676840432876"} 2023-02-19 21:00:32,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=34, state=RUNNABLE; CloseRegionProcedure c0388ad808943de6c7dc2df52080a97c, server=jenkins-hbase4.apache.org,36869,1676840426520}] 2023-02-19 21:00:32,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=35, state=RUNNABLE; CloseRegionProcedure 2db049a65e6635565eed2533a67d8159, server=jenkins-hbase4.apache.org,36745,1676840426551}] 2023-02-19 21:00:32,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=36, state=RUNNABLE; CloseRegionProcedure e2168e49d07e10a19fc572df72cf50bd, server=jenkins-hbase4.apache.org,36745,1676840426551}] 2023-02-19 21:00:32,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 0e78d795577e0972a2dde19200bbbe18, server=jenkins-hbase4.apache.org,36869,1676840426520}] 2023-02-19 21:00:32,882 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8527eef6fdb813a46ca9c74a5f40417f, UNASSIGN 2023-02-19 21:00:32,882 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7759deae7bf8c2f4262d7d3aa6c6ae17, UNASSIGN 2023-02-19 21:00:32,882 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6dff99fe8df12a16cd3ae0a3e51bb836, UNASSIGN 2023-02-19 21:00:32,883 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=581011ef8f897547ce6fb68ba1815867, UNASSIGN 2023-02-19 21:00:32,883 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=8527eef6fdb813a46ca9c74a5f40417f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:32,883 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=7759deae7bf8c2f4262d7d3aa6c6ae17, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:32,883 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840432883"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840432883"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840432883"}]},"ts":"1676840432883"} 2023-02-19 21:00:32,883 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6dff99fe8df12a16cd3ae0a3e51bb836, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:32,883 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840432883"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840432883"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840432883"}]},"ts":"1676840432883"} 2023-02-19 21:00:32,883 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840432883"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840432883"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840432883"}]},"ts":"1676840432883"} 2023-02-19 21:00:32,883 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=581011ef8f897547ce6fb68ba1815867, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:32,883 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840432883"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840432883"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840432883"}]},"ts":"1676840432883"} 2023-02-19 21:00:32,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=42, state=RUNNABLE; CloseRegionProcedure 8527eef6fdb813a46ca9c74a5f40417f, server=jenkins-hbase4.apache.org,36745,1676840426551}] 2023-02-19 21:00:32,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=41, state=RUNNABLE; CloseRegionProcedure 7759deae7bf8c2f4262d7d3aa6c6ae17, server=jenkins-hbase4.apache.org,36869,1676840426520}] 2023-02-19 21:00:32,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 91f9ad61a692d88a30724ae1b9195d5b, server=jenkins-hbase4.apache.org,36869,1676840426520}] 2023-02-19 21:00:32,887 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 6dff99fe8df12a16cd3ae0a3e51bb836, server=jenkins-hbase4.apache.org,36745,1676840426551}] 2023-02-19 21:00:32,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 581011ef8f897547ce6fb68ba1815867, server=jenkins-hbase4.apache.org,36869,1676840426520}] 2023-02-19 21:00:32,892 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a5bb8caaca1c08f803feb67df12422b, UNASSIGN 2023-02-19 21:00:32,893 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8a5bb8caaca1c08f803feb67df12422b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:32,893 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840432893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840432893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840432893"}]},"ts":"1676840432893"} 2023-02-19 21:00:32,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure 8a5bb8caaca1c08f803feb67df12422b, server=jenkins-hbase4.apache.org,36745,1676840426551}] 2023-02-19 21:00:32,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 21:00:32,985 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 21:00:33,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:33,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:33,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 581011ef8f897547ce6fb68ba1815867, disabling compactions & flushes 2023-02-19 21:00:33,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2db049a65e6635565eed2533a67d8159, disabling compactions & flushes 2023-02-19 21:00:33,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:33,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:33,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:33,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:33,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. after waiting 0 ms 2023-02-19 21:00:33,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:33,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. after waiting 0 ms 2023-02-19 21:00:33,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:33,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:33,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:33,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159. 2023-02-19 21:00:33,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2db049a65e6635565eed2533a67d8159: 2023-02-19 21:00:33,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867. 2023-02-19 21:00:33,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 581011ef8f897547ce6fb68ba1815867: 2023-02-19 21:00:33,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:33,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:33,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6dff99fe8df12a16cd3ae0a3e51bb836, disabling compactions & flushes 2023-02-19 21:00:33,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:33,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:33,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. after waiting 0 ms 2023-02-19 21:00:33,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:33,045 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=2db049a65e6635565eed2533a67d8159, regionState=CLOSED 2023-02-19 21:00:33,045 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840433045"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840433045"}]},"ts":"1676840433045"} 2023-02-19 21:00:33,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:33,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:33,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c0388ad808943de6c7dc2df52080a97c, disabling compactions & flushes 2023-02-19 21:00:33,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:33,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:33,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. after waiting 0 ms 2023-02-19 21:00:33,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:33,046 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=581011ef8f897547ce6fb68ba1815867, regionState=CLOSED 2023-02-19 21:00:33,046 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840433046"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840433046"}]},"ts":"1676840433046"} 2023-02-19 21:00:33,049 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=35 2023-02-19 21:00:33,049 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=35, state=SUCCESS; CloseRegionProcedure 2db049a65e6635565eed2533a67d8159, server=jenkins-hbase4.apache.org,36745,1676840426551 in 169 msec 2023-02-19 21:00:33,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 21:00:33,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:33,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c. 2023-02-19 21:00:33,051 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-19 21:00:33,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c0388ad808943de6c7dc2df52080a97c: 2023-02-19 21:00:33,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836. 2023-02-19 21:00:33,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2db049a65e6635565eed2533a67d8159, UNASSIGN in 176 msec 2023-02-19 21:00:33,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 581011ef8f897547ce6fb68ba1815867, server=jenkins-hbase4.apache.org,36869,1676840426520 in 160 msec 2023-02-19 21:00:33,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6dff99fe8df12a16cd3ae0a3e51bb836: 2023-02-19 21:00:33,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=581011ef8f897547ce6fb68ba1815867, UNASSIGN in 179 msec 2023-02-19 21:00:33,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:33,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:33,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7759deae7bf8c2f4262d7d3aa6c6ae17, disabling compactions & flushes 2023-02-19 21:00:33,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:33,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:33,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. after waiting 0 ms 2023-02-19 21:00:33,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:33,054 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=c0388ad808943de6c7dc2df52080a97c, regionState=CLOSED 2023-02-19 21:00:33,054 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676840433054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840433054"}]},"ts":"1676840433054"} 2023-02-19 21:00:33,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:33,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:33,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e2168e49d07e10a19fc572df72cf50bd, disabling compactions & flushes 2023-02-19 21:00:33,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:33,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:33,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. after waiting 0 ms 2023-02-19 21:00:33,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:33,055 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6dff99fe8df12a16cd3ae0a3e51bb836, regionState=CLOSED 2023-02-19 21:00:33,055 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840433055"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840433055"}]},"ts":"1676840433055"} 2023-02-19 21:00:33,058 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=34 2023-02-19 21:00:33,058 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=34, state=SUCCESS; CloseRegionProcedure c0388ad808943de6c7dc2df52080a97c, server=jenkins-hbase4.apache.org,36869,1676840426520 in 179 msec 2023-02-19 21:00:33,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:33,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-19 21:00:33,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 6dff99fe8df12a16cd3ae0a3e51bb836, server=jenkins-hbase4.apache.org,36745,1676840426551 in 170 msec 2023-02-19 21:00:33,059 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c0388ad808943de6c7dc2df52080a97c, UNASSIGN in 185 msec 2023-02-19 21:00:33,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:33,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6dff99fe8df12a16cd3ae0a3e51bb836, UNASSIGN in 186 msec 2023-02-19 21:00:33,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd. 2023-02-19 21:00:33,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e2168e49d07e10a19fc572df72cf50bd: 2023-02-19 21:00:33,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17. 2023-02-19 21:00:33,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7759deae7bf8c2f4262d7d3aa6c6ae17: 2023-02-19 21:00:33,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:33,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:33,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8a5bb8caaca1c08f803feb67df12422b, disabling compactions & flushes 2023-02-19 21:00:33,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:33,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:33,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. after waiting 0 ms 2023-02-19 21:00:33,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:33,063 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e2168e49d07e10a19fc572df72cf50bd, regionState=CLOSED 2023-02-19 21:00:33,063 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840433063"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840433063"}]},"ts":"1676840433063"} 2023-02-19 21:00:33,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:33,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:33,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0e78d795577e0972a2dde19200bbbe18, disabling compactions & flushes 2023-02-19 21:00:33,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:33,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:33,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. after waiting 0 ms 2023-02-19 21:00:33,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:33,064 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=7759deae7bf8c2f4262d7d3aa6c6ae17, regionState=CLOSED 2023-02-19 21:00:33,064 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840433064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840433064"}]},"ts":"1676840433064"} 2023-02-19 21:00:33,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=36 2023-02-19 21:00:33,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=36, state=SUCCESS; CloseRegionProcedure e2168e49d07e10a19fc572df72cf50bd, server=jenkins-hbase4.apache.org,36745,1676840426551 in 186 msec 2023-02-19 21:00:33,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=41 2023-02-19 21:00:33,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=41, state=SUCCESS; CloseRegionProcedure 7759deae7bf8c2f4262d7d3aa6c6ae17, server=jenkins-hbase4.apache.org,36869,1676840426520 in 179 msec 2023-02-19 21:00:33,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2168e49d07e10a19fc572df72cf50bd, UNASSIGN in 193 msec 2023-02-19 21:00:33,067 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7759deae7bf8c2f4262d7d3aa6c6ae17, UNASSIGN in 193 msec 2023-02-19 21:00:33,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 21:00:33,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18. 2023-02-19 21:00:33,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0e78d795577e0972a2dde19200bbbe18: 2023-02-19 21:00:33,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:33,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:33,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 91f9ad61a692d88a30724ae1b9195d5b, disabling compactions & flushes 2023-02-19 21:00:33,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:33,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:33,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. after waiting 0 ms 2023-02-19 21:00:33,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:33,071 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0e78d795577e0972a2dde19200bbbe18, regionState=CLOSED 2023-02-19 21:00:33,071 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676840433071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840433071"}]},"ts":"1676840433071"} 2023-02-19 21:00:33,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:33,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-19 21:00:33,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 0e78d795577e0972a2dde19200bbbe18, server=jenkins-hbase4.apache.org,36869,1676840426520 in 192 msec 2023-02-19 21:00:33,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0e78d795577e0972a2dde19200bbbe18, UNASSIGN in 200 msec 2023-02-19 21:00:33,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b. 2023-02-19 21:00:33,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8a5bb8caaca1c08f803feb67df12422b: 2023-02-19 21:00:33,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:33,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:33,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8527eef6fdb813a46ca9c74a5f40417f, disabling compactions & flushes 2023-02-19 21:00:33,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:33,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:33,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. after waiting 0 ms 2023-02-19 21:00:33,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:33,082 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8a5bb8caaca1c08f803feb67df12422b, regionState=CLOSED 2023-02-19 21:00:33,082 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840433082"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840433082"}]},"ts":"1676840433082"} 2023-02-19 21:00:33,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:33,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b. 2023-02-19 21:00:33,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 91f9ad61a692d88a30724ae1b9195d5b: 2023-02-19 21:00:33,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-19 21:00:33,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:33,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure 8a5bb8caaca1c08f803feb67df12422b, server=jenkins-hbase4.apache.org,36745,1676840426551 in 188 msec 2023-02-19 21:00:33,090 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=91f9ad61a692d88a30724ae1b9195d5b, regionState=CLOSED 2023-02-19 21:00:33,090 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840433090"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840433090"}]},"ts":"1676840433090"} 2023-02-19 21:00:33,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a5bb8caaca1c08f803feb67df12422b, UNASSIGN in 216 msec 2023-02-19 21:00:33,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:33,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f. 2023-02-19 21:00:33,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8527eef6fdb813a46ca9c74a5f40417f: 2023-02-19 21:00:33,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:33,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-19 21:00:33,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 91f9ad61a692d88a30724ae1b9195d5b, server=jenkins-hbase4.apache.org,36869,1676840426520 in 204 msec 2023-02-19 21:00:33,092 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=8527eef6fdb813a46ca9c74a5f40417f, regionState=CLOSED 2023-02-19 21:00:33,093 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676840433092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840433092"}]},"ts":"1676840433092"} 2023-02-19 21:00:33,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91f9ad61a692d88a30724ae1b9195d5b, UNASSIGN in 219 msec 2023-02-19 21:00:33,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=42 2023-02-19 21:00:33,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=42, state=SUCCESS; CloseRegionProcedure 8527eef6fdb813a46ca9c74a5f40417f, server=jenkins-hbase4.apache.org,36745,1676840426551 in 210 msec 2023-02-19 21:00:33,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=33 2023-02-19 21:00:33,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8527eef6fdb813a46ca9c74a5f40417f, UNASSIGN in 222 msec 2023-02-19 21:00:33,097 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840433097"}]},"ts":"1676840433097"} 2023-02-19 21:00:33,098 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-19 21:00:33,099 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-19 21:00:33,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 234 msec 2023-02-19 21:00:33,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 21:00:33,173 INFO [Listener at localhost/36919] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-19 21:00:33,173 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-19 21:00:33,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:33,175 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:33,176 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:33,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 21:00:33,185 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:33,185 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:33,185 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:33,186 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:33,185 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:33,185 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:33,185 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:33,185 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:33,188 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/f1, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/f2, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/recovered.edits] 2023-02-19 21:00:33,189 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/recovered.edits] 2023-02-19 21:00:33,189 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/recovered.edits] 2023-02-19 21:00:33,190 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/recovered.edits] 2023-02-19 21:00:33,190 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/recovered.edits] 2023-02-19 21:00:33,190 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/recovered.edits] 2023-02-19 21:00:33,190 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/recovered.edits] 2023-02-19 21:00:33,191 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/recovered.edits] 2023-02-19 21:00:33,198 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1/5c86935aede743a78d844befacdff3f7 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1/5c86935aede743a78d844befacdff3f7 2023-02-19 21:00:33,198 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1/6a65387d44bb4801b4e2539717d892d0 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1/6a65387d44bb4801b4e2539717d892d0 2023-02-19 21:00:33,199 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1/4d140607b2c941b2a90acddcb1480451 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1/4d140607b2c941b2a90acddcb1480451 2023-02-19 21:00:33,199 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1/0e359e9ef126451e93ef0a0c74d22b6e to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1/0e359e9ef126451e93ef0a0c74d22b6e 2023-02-19 21:00:33,200 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1/0aacc30393f54313a7c3a1ff4eae6384 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1/0aacc30393f54313a7c3a1ff4eae6384 2023-02-19 21:00:33,200 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1/080b470674ca419fa8ad4c3d78c8bf88 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1/080b470674ca419fa8ad4c3d78c8bf88 2023-02-19 21:00:33,202 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1/71dc07896a794b7596ae28d71054579c to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f1/71dc07896a794b7596ae28d71054579c 2023-02-19 21:00:33,202 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1/75455f7548084e608de535e656bbaae4 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1/75455f7548084e608de535e656bbaae4 2023-02-19 21:00:33,202 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1/c0505e5ac2ff462c88980f37ece00922 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f1/c0505e5ac2ff462c88980f37ece00922 2023-02-19 21:00:33,202 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1/84c677e5f1424c00b8d72b1cc7a9a93b to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f1/84c677e5f1424c00b8d72b1cc7a9a93b 2023-02-19 21:00:33,203 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1/28b7d2b184214936bfb734d7338b675d to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f1/28b7d2b184214936bfb734d7338b675d 2023-02-19 21:00:33,203 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1/110c86e26a35483eab4907a52271d837 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f1/110c86e26a35483eab4907a52271d837 2023-02-19 21:00:33,203 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1/858f1001100b4600ab462f257226195c to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f1/858f1001100b4600ab462f257226195c 2023-02-19 21:00:33,205 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1/e63dfa0fe98d4c479b891a6620057739 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f1/e63dfa0fe98d4c479b891a6620057739 2023-02-19 21:00:33,205 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/recovered.edits/6.seqid to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c/recovered.edits/6.seqid 2023-02-19 21:00:33,206 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c0388ad808943de6c7dc2df52080a97c 2023-02-19 21:00:33,206 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:33,209 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2/04d445a8e6bd42fea0b95b10cd727b1c to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2/04d445a8e6bd42fea0b95b10cd727b1c 2023-02-19 21:00:33,210 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2/5c1183bb138f4693bcc13968deb36ea9 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2/5c1183bb138f4693bcc13968deb36ea9 2023-02-19 21:00:33,210 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2/b557ec95769f4f03b792daf3ef32694d to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2/b557ec95769f4f03b792daf3ef32694d 2023-02-19 21:00:33,210 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2/0b6bae875d3e47068bc8aa3c1bafb614 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2/0b6bae875d3e47068bc8aa3c1bafb614 2023-02-19 21:00:33,211 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2/3faaa2afd4e54de9a5125e7b9184830a to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2/3faaa2afd4e54de9a5125e7b9184830a 2023-02-19 21:00:33,212 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/recovered.edits] 2023-02-19 21:00:33,212 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2/35bbcf7d16b34e84b86d5b50cbc6d2ce to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2/35bbcf7d16b34e84b86d5b50cbc6d2ce 2023-02-19 21:00:33,213 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2/76a69fb454dc4a5583b9e90a78435ee1 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/f2/76a69fb454dc4a5583b9e90a78435ee1 2023-02-19 21:00:33,213 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2/32fed20b2e2a4295bcc975e56b12c1a5 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2/32fed20b2e2a4295bcc975e56b12c1a5 2023-02-19 21:00:33,214 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2/ec55c181c96049809086fff7641df80b to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/f2/ec55c181c96049809086fff7641df80b 2023-02-19 21:00:33,214 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2/f7c3c1d967a94809aadf1b77de996edc to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/f2/f7c3c1d967a94809aadf1b77de996edc 2023-02-19 21:00:33,214 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2/de522e51562440eeaddad5ffdf94e4cf to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/f2/de522e51562440eeaddad5ffdf94e4cf 2023-02-19 21:00:33,214 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2/cc3d4876ad5d483ab89a6a56dddac9ee to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/f2/cc3d4876ad5d483ab89a6a56dddac9ee 2023-02-19 21:00:33,215 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2/64fe155f7e16435f8da6de063758b01a to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/f2/64fe155f7e16435f8da6de063758b01a 2023-02-19 21:00:33,217 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2/78158f9ba66148079c80c721789f8665 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/f2/78158f9ba66148079c80c721789f8665 2023-02-19 21:00:33,221 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/recovered.edits/12.seqid to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd/recovered.edits/12.seqid 2023-02-19 21:00:33,221 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/recovered.edits/12.seqid to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b/recovered.edits/12.seqid 2023-02-19 21:00:33,222 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/recovered.edits/12.seqid to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867/recovered.edits/12.seqid 2023-02-19 21:00:33,222 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/recovered.edits/12.seqid to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17/recovered.edits/12.seqid 2023-02-19 21:00:33,222 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91f9ad61a692d88a30724ae1b9195d5b 2023-02-19 21:00:33,222 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:33,223 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2168e49d07e10a19fc572df72cf50bd 2023-02-19 21:00:33,223 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/recovered.edits/12.seqid to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159/recovered.edits/12.seqid 2023-02-19 21:00:33,223 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1/13489289efbf423c80ebe892103c7d00 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1/13489289efbf423c80ebe892103c7d00 2023-02-19 21:00:33,223 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/recovered.edits/12.seqid to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836/recovered.edits/12.seqid 2023-02-19 21:00:33,223 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/581011ef8f897547ce6fb68ba1815867 2023-02-19 21:00:33,224 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/7759deae7bf8c2f4262d7d3aa6c6ae17 2023-02-19 21:00:33,224 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/2db049a65e6635565eed2533a67d8159 2023-02-19 21:00:33,224 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/6dff99fe8df12a16cd3ae0a3e51bb836 2023-02-19 21:00:33,225 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/recovered.edits/12.seqid to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b/recovered.edits/12.seqid 2023-02-19 21:00:33,225 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1/bd852a4571d84a519d89d2bfb08b3cfd to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f1/bd852a4571d84a519d89d2bfb08b3cfd 2023-02-19 21:00:33,225 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/f1, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/f2, FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/recovered.edits] 2023-02-19 21:00:33,225 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a5bb8caaca1c08f803feb67df12422b 2023-02-19 21:00:33,228 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2/1df3e69d77764c589a7aae8a498be6b0 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2/1df3e69d77764c589a7aae8a498be6b0 2023-02-19 21:00:33,229 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2/9f1dfc2ca7804dae9617f6fba4071f47 to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/f2/9f1dfc2ca7804dae9617f6fba4071f47 2023-02-19 21:00:33,230 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/recovered.edits/6.seqid to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18/recovered.edits/6.seqid 2023-02-19 21:00:33,231 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/0e78d795577e0972a2dde19200bbbe18 2023-02-19 21:00:33,232 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/recovered.edits/12.seqid to hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/archive/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f/recovered.edits/12.seqid 2023-02-19 21:00:33,232 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/.tmp/data/default/testWithMockedMapReduceMultiRegion/8527eef6fdb813a46ca9c74a5f40417f 2023-02-19 21:00:33,232 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-19 21:00:33,234 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:33,237 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-19 21:00:33,239 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-19 21:00:33,240 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:33,240 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-19 21:00:33,240 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840433240"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:33,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840433240"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:33,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840433240"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:33,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840433240"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:33,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840433240"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:33,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840433240"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:33,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840433240"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:33,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840433240"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:33,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840433240"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:33,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840433240"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:33,242 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-19 21:00:33,243 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c0388ad808943de6c7dc2df52080a97c, NAME => 'testWithMockedMapReduceMultiRegion,,1676840428084.c0388ad808943de6c7dc2df52080a97c.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 2db049a65e6635565eed2533a67d8159, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676840428084.2db049a65e6635565eed2533a67d8159.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => e2168e49d07e10a19fc572df72cf50bd, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676840428084.e2168e49d07e10a19fc572df72cf50bd.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 91f9ad61a692d88a30724ae1b9195d5b, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676840428084.91f9ad61a692d88a30724ae1b9195d5b.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 8a5bb8caaca1c08f803feb67df12422b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676840428084.8a5bb8caaca1c08f803feb67df12422b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 581011ef8f897547ce6fb68ba1815867, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676840428084.581011ef8f897547ce6fb68ba1815867.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 6dff99fe8df12a16cd3ae0a3e51bb836, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676840428084.6dff99fe8df12a16cd3ae0a3e51bb836.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 7759deae7bf8c2f4262d7d3aa6c6ae17, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676840428084.7759deae7bf8c2f4262d7d3aa6c6ae17.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 8527eef6fdb813a46ca9c74a5f40417f, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676840428084.8527eef6fdb813a46ca9c74a5f40417f.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 0e78d795577e0972a2dde19200bbbe18, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676840428084.0e78d795577e0972a2dde19200bbbe18.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-19 21:00:33,243 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-19 21:00:33,243 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676840433243"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:33,244 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-19 21:00:33,250 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 21:00:33,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 77 msec 2023-02-19 21:00:33,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38589] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 21:00:33,278 INFO [Listener at localhost/36919] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-19 21:00:33,278 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 21:00:33,278 INFO [Listener at localhost/36919] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 21:00:33,278 DEBUG [Listener at localhost/36919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x394ae7ca to 127.0.0.1:61237 2023-02-19 21:00:33,279 DEBUG [Listener at localhost/36919] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:33,279 DEBUG [Listener at localhost/36919] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 21:00:33,279 DEBUG [Listener at localhost/36919] util.JVMClusterUtil(257): Found active master hash=2029530058, stopped=false 2023-02-19 21:00:33,279 INFO [Listener at localhost/36919] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38589,1676840426480 2023-02-19 21:00:33,281 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:33,281 INFO [Listener at localhost/36919] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 21:00:33,281 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:33,281 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:33,281 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:33,283 DEBUG [Listener at localhost/36919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50064498 to 127.0.0.1:61237 2023-02-19 21:00:33,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:33,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:33,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:33,283 DEBUG [Listener at localhost/36919] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:33,284 INFO [Listener at localhost/36919] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36869,1676840426520' ***** 2023-02-19 21:00:33,284 INFO [Listener at localhost/36919] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:33,284 INFO [Listener at localhost/36919] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36745,1676840426551' ***** 2023-02-19 21:00:33,284 INFO [Listener at localhost/36919] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:33,284 INFO [RS:0;jenkins-hbase4:36869] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:33,284 INFO [RS:0;jenkins-hbase4:36869] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:33,284 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:33,284 INFO [RS:0;jenkins-hbase4:36869] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:33,285 INFO [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(3304): Received CLOSE for c14a09e9b8da3cf7b590ac48f2e2f678 2023-02-19 21:00:33,285 INFO [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:33,285 INFO [RS:1;jenkins-hbase4:36745] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:33,285 DEBUG [RS:0;jenkins-hbase4:36869] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2824ed7b to 127.0.0.1:61237 2023-02-19 21:00:33,286 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:33,286 DEBUG [RS:0;jenkins-hbase4:36869] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:33,287 INFO [RS:0;jenkins-hbase4:36869] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:33,287 INFO [RS:0;jenkins-hbase4:36869] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:33,287 INFO [RS:0;jenkins-hbase4:36869] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:33,286 INFO [RS:1;jenkins-hbase4:36745] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:33,287 INFO [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 21:00:33,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c14a09e9b8da3cf7b590ac48f2e2f678, disabling compactions & flushes 2023-02-19 21:00:33,287 INFO [RS:1;jenkins-hbase4:36745] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:33,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. 2023-02-19 21:00:33,287 INFO [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-19 21:00:33,287 INFO [RS:1;jenkins-hbase4:36745] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:33,287 DEBUG [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1479): Online Regions={c14a09e9b8da3cf7b590ac48f2e2f678=hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678., 1588230740=hbase:meta,,1.1588230740} 2023-02-19 21:00:33,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. 2023-02-19 21:00:33,289 DEBUG [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1505): Waiting on 1588230740, c14a09e9b8da3cf7b590ac48f2e2f678 2023-02-19 21:00:33,289 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:33,287 DEBUG [RS:1;jenkins-hbase4:36745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x574fad75 to 127.0.0.1:61237 2023-02-19 21:00:33,289 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:33,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. after waiting 0 ms 2023-02-19 21:00:33,289 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:33,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. 2023-02-19 21:00:33,289 DEBUG [RS:1;jenkins-hbase4:36745] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:33,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c14a09e9b8da3cf7b590ac48f2e2f678 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 21:00:33,289 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:33,289 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:33,289 INFO [RS:1;jenkins-hbase4:36745] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36745,1676840426551; all regions closed. 2023-02-19 21:00:33,289 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-19 21:00:33,294 DEBUG [RS:1;jenkins-hbase4:36745] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/oldWALs 2023-02-19 21:00:33,294 INFO [RS:1;jenkins-hbase4:36745] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36745%2C1676840426551:(num 1676840427856) 2023-02-19 21:00:33,294 DEBUG [RS:1;jenkins-hbase4:36745] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:33,294 INFO [RS:1;jenkins-hbase4:36745] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:33,294 INFO [RS:1;jenkins-hbase4:36745] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:33,294 INFO [RS:1;jenkins-hbase4:36745] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:33,294 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:33,294 INFO [RS:1;jenkins-hbase4:36745] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:33,295 INFO [RS:1;jenkins-hbase4:36745] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:33,296 INFO [RS:1;jenkins-hbase4:36745] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36745 2023-02-19 21:00:33,298 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:33,298 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:33,298 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36745,1676840426551 2023-02-19 21:00:33,298 ERROR [Listener at localhost/36919-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47dc0a0a rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:33,298 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:33,298 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:33,298 ERROR [Listener at localhost/36919-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10865491 rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:33,299 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36745,1676840426551] 2023-02-19 21:00:33,299 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36745,1676840426551; numProcessing=1 2023-02-19 21:00:33,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678/.tmp/info/8a919a1b1e9f4d009b237bb7af535caa 2023-02-19 21:00:33,301 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/.tmp/info/6c10c26761814a0eb425ec64234b5d14 2023-02-19 21:00:33,302 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36745,1676840426551 already deleted, retry=false 2023-02-19 21:00:33,302 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36745,1676840426551 expired; onlineServers=1 2023-02-19 21:00:33,305 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c10c26761814a0eb425ec64234b5d14 2023-02-19 21:00:33,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678/.tmp/info/8a919a1b1e9f4d009b237bb7af535caa as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678/info/8a919a1b1e9f4d009b237bb7af535caa 2023-02-19 21:00:33,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678/info/8a919a1b1e9f4d009b237bb7af535caa, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 21:00:33,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c14a09e9b8da3cf7b590ac48f2e2f678 in 23ms, sequenceid=6, compaction requested=false 2023-02-19 21:00:33,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/namespace/c14a09e9b8da3cf7b590ac48f2e2f678/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 21:00:33,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. 2023-02-19 21:00:33,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c14a09e9b8da3cf7b590ac48f2e2f678: 2023-02-19 21:00:33,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676840427520.c14a09e9b8da3cf7b590ac48f2e2f678. 2023-02-19 21:00:33,326 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:33,329 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:33,481 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:33,481 INFO [RS:1;jenkins-hbase4:36745] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36745,1676840426551; zookeeper connection closed. 2023-02-19 21:00:33,481 ERROR [Listener at localhost/36919-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68208ac3 rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:33,481 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36745-0x1006e6245a10002, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:33,481 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2d74dc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2d74dc 2023-02-19 21:00:33,481 ERROR [Listener at localhost/36919-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@44ce1dea rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:33,489 DEBUG [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 21:00:33,689 DEBUG [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 21:00:33,717 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/.tmp/rep_barrier/dcb4b2d157ea4c6ba978b6935c846eaa 2023-02-19 21:00:33,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dcb4b2d157ea4c6ba978b6935c846eaa 2023-02-19 21:00:33,728 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/.tmp/table/19bf252729da41348ce1b3e92a06e804 2023-02-19 21:00:33,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19bf252729da41348ce1b3e92a06e804 2023-02-19 21:00:33,731 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/.tmp/info/6c10c26761814a0eb425ec64234b5d14 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/info/6c10c26761814a0eb425ec64234b5d14 2023-02-19 21:00:33,735 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c10c26761814a0eb425ec64234b5d14 2023-02-19 21:00:33,735 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/info/6c10c26761814a0eb425ec64234b5d14, entries=30, sequenceid=57, filesize=8.3 K 2023-02-19 21:00:33,735 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/.tmp/rep_barrier/dcb4b2d157ea4c6ba978b6935c846eaa as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/rep_barrier/dcb4b2d157ea4c6ba978b6935c846eaa 2023-02-19 21:00:33,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dcb4b2d157ea4c6ba978b6935c846eaa 2023-02-19 21:00:33,739 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/rep_barrier/dcb4b2d157ea4c6ba978b6935c846eaa, entries=10, sequenceid=57, filesize=6.1 K 2023-02-19 21:00:33,739 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/.tmp/table/19bf252729da41348ce1b3e92a06e804 as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/table/19bf252729da41348ce1b3e92a06e804 2023-02-19 21:00:33,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19bf252729da41348ce1b3e92a06e804 2023-02-19 21:00:33,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/table/19bf252729da41348ce1b3e92a06e804, entries=13, sequenceid=57, filesize=6.1 K 2023-02-19 21:00:33,743 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 454ms, sequenceid=57, compaction requested=false 2023-02-19 21:00:33,746 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-19 21:00:33,746 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 21:00:33,746 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:33,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:33,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:33,819 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 21:00:33,819 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 21:00:33,890 INFO [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36869,1676840426520; all regions closed. 2023-02-19 21:00:33,893 DEBUG [RS:0;jenkins-hbase4:36869] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/oldWALs 2023-02-19 21:00:33,894 INFO [RS:0;jenkins-hbase4:36869] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36869%2C1676840426520.meta:.meta(num 1676840427466) 2023-02-19 21:00:33,897 DEBUG [RS:0;jenkins-hbase4:36869] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/oldWALs 2023-02-19 21:00:33,897 INFO [RS:0;jenkins-hbase4:36869] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36869%2C1676840426520:(num 1676840427847) 2023-02-19 21:00:33,897 DEBUG [RS:0;jenkins-hbase4:36869] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:33,897 INFO [RS:0;jenkins-hbase4:36869] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:33,897 INFO [RS:0;jenkins-hbase4:36869] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:33,897 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:33,899 INFO [RS:0;jenkins-hbase4:36869] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36869 2023-02-19 21:00:33,900 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:33,900 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36869,1676840426520 2023-02-19 21:00:33,900 ERROR [Listener at localhost/36919-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1fac623c rejected from java.util.concurrent.ThreadPoolExecutor@1b93f511[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:33,902 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36869,1676840426520] 2023-02-19 21:00:33,902 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36869,1676840426520; numProcessing=2 2023-02-19 21:00:33,903 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36869,1676840426520 already deleted, retry=false 2023-02-19 21:00:33,903 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36869,1676840426520 expired; onlineServers=0 2023-02-19 21:00:33,903 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38589,1676840426480' ***** 2023-02-19 21:00:33,903 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 21:00:33,904 DEBUG [M:0;jenkins-hbase4:38589] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cc7b00d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:33,904 INFO [M:0;jenkins-hbase4:38589] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38589,1676840426480 2023-02-19 21:00:33,904 INFO [M:0;jenkins-hbase4:38589] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38589,1676840426480; all regions closed. 2023-02-19 21:00:33,904 DEBUG [M:0;jenkins-hbase4:38589] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:33,904 DEBUG [M:0;jenkins-hbase4:38589] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 21:00:33,904 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 21:00:33,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840426701] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840426701,5,FailOnTimeoutGroup] 2023-02-19 21:00:33,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840426700] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840426700,5,FailOnTimeoutGroup] 2023-02-19 21:00:33,904 DEBUG [M:0;jenkins-hbase4:38589] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 21:00:33,906 INFO [M:0;jenkins-hbase4:38589] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 21:00:33,906 INFO [M:0;jenkins-hbase4:38589] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 21:00:33,906 INFO [M:0;jenkins-hbase4:38589] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 21:00:33,906 DEBUG [M:0;jenkins-hbase4:38589] master.HMaster(1512): Stopping service threads 2023-02-19 21:00:33,906 INFO [M:0;jenkins-hbase4:38589] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 21:00:33,907 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:33,907 ERROR [M:0;jenkins-hbase4:38589] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 21:00:33,907 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:33,907 INFO [M:0;jenkins-hbase4:38589] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 21:00:33,907 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 21:00:33,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:33,907 DEBUG [M:0;jenkins-hbase4:38589] zookeeper.ZKUtil(398): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 21:00:33,907 WARN [M:0;jenkins-hbase4:38589] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 21:00:33,907 INFO [M:0;jenkins-hbase4:38589] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 21:00:33,908 INFO [M:0;jenkins-hbase4:38589] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 21:00:33,908 DEBUG [M:0;jenkins-hbase4:38589] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:33,908 INFO [M:0;jenkins-hbase4:38589] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:33,908 DEBUG [M:0;jenkins-hbase4:38589] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:33,908 DEBUG [M:0;jenkins-hbase4:38589] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:33,908 DEBUG [M:0;jenkins-hbase4:38589] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:33,908 INFO [M:0;jenkins-hbase4:38589] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.12 KB heapSize=200.04 KB 2023-02-19 21:00:33,916 INFO [M:0;jenkins-hbase4:38589] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.12 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/60978ba96e2843d78361b9f2a8beffbc 2023-02-19 21:00:33,920 DEBUG [M:0;jenkins-hbase4:38589] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/60978ba96e2843d78361b9f2a8beffbc as hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/60978ba96e2843d78361b9f2a8beffbc 2023-02-19 21:00:33,924 INFO [M:0;jenkins-hbase4:38589] regionserver.HStore(1080): Added hdfs://localhost:46315/user/jenkins/test-data/483de9d1-2424-946a-c6c6-1104f3f5507a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/60978ba96e2843d78361b9f2a8beffbc, entries=53, sequenceid=357, filesize=10.7 K 2023-02-19 21:00:33,924 INFO [M:0;jenkins-hbase4:38589] regionserver.HRegion(2947): Finished flush of dataSize ~167.12 KB/171131, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-19 21:00:33,925 INFO [M:0;jenkins-hbase4:38589] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:33,925 DEBUG [M:0;jenkins-hbase4:38589] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:33,928 INFO [M:0;jenkins-hbase4:38589] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 21:00:33,928 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:33,929 INFO [M:0;jenkins-hbase4:38589] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38589 2023-02-19 21:00:33,931 DEBUG [M:0;jenkins-hbase4:38589] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38589,1676840426480 already deleted, retry=false 2023-02-19 21:00:34,002 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:34,002 INFO [RS:0;jenkins-hbase4:36869] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36869,1676840426520; zookeeper connection closed. 2023-02-19 21:00:34,002 ERROR [Listener at localhost/36919-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13447d22 rejected from java.util.concurrent.ThreadPoolExecutor@1b93f511[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:34,002 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): regionserver:36869-0x1006e6245a10001, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:34,002 ERROR [Listener at localhost/36919-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b3a1b78 rejected from java.util.concurrent.ThreadPoolExecutor@1b93f511[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:34,002 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5c0bdf1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5c0bdf1 2023-02-19 21:00:34,003 INFO [Listener at localhost/36919] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 21:00:34,102 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:34,102 INFO [M:0;jenkins-hbase4:38589] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38589,1676840426480; zookeeper connection closed. 2023-02-19 21:00:34,102 ERROR [Listener at localhost/36919-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2df57874 rejected from java.util.concurrent.ThreadPoolExecutor@29caf912[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:34,103 DEBUG [Listener at localhost/36919-EventThread] zookeeper.ZKWatcher(600): master:38589-0x1006e6245a10000, quorum=127.0.0.1:61237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:34,103 ERROR [Listener at localhost/36919-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b5e5c36 rejected from java.util.concurrent.ThreadPoolExecutor@29caf912[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:34,103 WARN [Listener at localhost/36919] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:34,107 INFO [Listener at localhost/36919] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:34,213 WARN [BP-891307259-172.31.14.131-1676840425861 heartbeating to localhost/127.0.0.1:46315] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:34,213 WARN [BP-891307259-172.31.14.131-1676840425861 heartbeating to localhost/127.0.0.1:46315] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-891307259-172.31.14.131-1676840425861 (Datanode Uuid 7e08c0bd-f1e9-40e4-a734-c8d73063677b) service to localhost/127.0.0.1:46315 2023-02-19 21:00:34,214 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/cluster_dc685777-3cbf-810d-492c-7972792fa62e/dfs/data/data3/current/BP-891307259-172.31.14.131-1676840425861] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:34,215 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/cluster_dc685777-3cbf-810d-492c-7972792fa62e/dfs/data/data4/current/BP-891307259-172.31.14.131-1676840425861] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:34,217 WARN [Listener at localhost/36919] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:34,219 INFO [Listener at localhost/36919] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:34,325 WARN [BP-891307259-172.31.14.131-1676840425861 heartbeating to localhost/127.0.0.1:46315] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:34,325 WARN [BP-891307259-172.31.14.131-1676840425861 heartbeating to localhost/127.0.0.1:46315] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-891307259-172.31.14.131-1676840425861 (Datanode Uuid cf3b2580-5fb1-42cd-9072-fec1bcbeac73) service to localhost/127.0.0.1:46315 2023-02-19 21:00:34,325 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/cluster_dc685777-3cbf-810d-492c-7972792fa62e/dfs/data/data1/current/BP-891307259-172.31.14.131-1676840425861] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:34,326 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/cluster_dc685777-3cbf-810d-492c-7972792fa62e/dfs/data/data2/current/BP-891307259-172.31.14.131-1676840425861] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:34,335 INFO [Listener at localhost/36919] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:34,456 INFO [Listener at localhost/36919] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 21:00:34,494 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 21:00:34,510 INFO [Listener at localhost/36919] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=227 (was 176) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36919.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46315 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36919.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36919.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:46315 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/36919.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36919.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:46315 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:46315 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:46315 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:46315 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36919 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38589,1676840426480)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36919.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36919.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36919.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/36919.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:46315 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/36919.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=616 (was 565) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=311 (was 315), ProcessCount=170 (was 170), AvailableMemoryMB=8990 (was 9065) 2023-02-19 21:00:34,520 INFO [Listener at localhost/36919] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=227, OpenFileDescriptor=616, MaxFileDescriptor=60000, SystemLoadAverage=311, ProcessCount=170, AvailableMemoryMB=8989 2023-02-19 21:00:34,531 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/hadoop.log.dir so I do NOT create it in target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60 2023-02-19 21:00:34,531 WARN [Listener at localhost/36919] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 21:00:34,531 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/hadoop.tmp.dir so I do NOT create it in target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60 2023-02-19 21:00:34,531 WARN [Listener at localhost/36919] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76974633-414a-385d-ccd9-6811fe704f23/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 21:00:34,531 DEBUG [Listener at localhost/36919] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60 2023-02-19 21:00:34,531 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 21:00:34,531 INFO [Listener at localhost/36919] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/cluster_5c4df952-d85b-af76-8d8a-055b52a7d4ba, deleteOnExit=true 2023-02-19 21:00:34,531 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 21:00:34,531 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/test.cache.data in system properties and HBase conf 2023-02-19 21:00:34,531 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 21:00:34,531 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/hadoop.log.dir in system properties and HBase conf 2023-02-19 21:00:34,531 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 21:00:34,532 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 21:00:34,532 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 21:00:34,532 DEBUG [Listener at localhost/36919] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 21:00:34,532 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 21:00:34,532 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 21:00:34,532 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 21:00:34,532 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 21:00:34,532 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 21:00:34,532 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 21:00:34,533 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 21:00:34,533 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 21:00:34,533 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 21:00:34,533 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/nfs.dump.dir in system properties and HBase conf 2023-02-19 21:00:34,533 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/java.io.tmpdir in system properties and HBase conf 2023-02-19 21:00:34,533 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 21:00:34,533 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 21:00:34,533 INFO [Listener at localhost/36919] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 21:00:34,537 WARN [Listener at localhost/36919] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 21:00:34,537 WARN [Listener at localhost/36919] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 21:00:34,580 WARN [Listener at localhost/36919] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:34,583 INFO [Listener at localhost/36919] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:34,591 INFO [Listener at localhost/36919] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/java.io.tmpdir/Jetty_localhost_34031_hdfs____iaxxdj/webapp 2023-02-19 21:00:34,683 INFO [Listener at localhost/36919] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34031 2023-02-19 21:00:34,688 WARN [Listener at localhost/36919] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 21:00:34,688 WARN [Listener at localhost/36919] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 21:00:34,732 WARN [Listener at localhost/39781] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:34,746 WARN [Listener at localhost/39781] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 21:00:34,748 WARN [Listener at localhost/39781] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:34,749 INFO [Listener at localhost/39781] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:34,756 INFO [Listener at localhost/39781] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/java.io.tmpdir/Jetty_localhost_33167_datanode____.mqoddz/webapp 2023-02-19 21:00:34,848 INFO [Listener at localhost/39781] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33167 2023-02-19 21:00:34,855 WARN [Listener at localhost/39901] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:34,867 WARN [Listener at localhost/39901] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 21:00:34,869 WARN [Listener at localhost/39901] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:34,870 INFO [Listener at localhost/39901] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:34,873 INFO [Listener at localhost/39901] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/java.io.tmpdir/Jetty_localhost_45035_datanode____.7e2fqg/webapp 2023-02-19 21:00:34,981 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9943c33639ae5150: Processing first storage report for DS-8982258d-5079-41ae-bf98-771dc07ee098 from datanode 4f3d790e-9a12-4c29-96e0-e4d6d524729e 2023-02-19 21:00:34,981 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9943c33639ae5150: from storage DS-8982258d-5079-41ae-bf98-771dc07ee098 node DatanodeRegistration(127.0.0.1:39791, datanodeUuid=4f3d790e-9a12-4c29-96e0-e4d6d524729e, infoPort=34707, infoSecurePort=0, ipcPort=39901, storageInfo=lv=-57;cid=testClusterID;nsid=1919872256;c=1676840434539), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:34,981 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9943c33639ae5150: Processing first storage report for DS-727b6353-e0a7-46b3-a251-3b0d661b2284 from datanode 4f3d790e-9a12-4c29-96e0-e4d6d524729e 2023-02-19 21:00:34,981 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9943c33639ae5150: from storage DS-727b6353-e0a7-46b3-a251-3b0d661b2284 node DatanodeRegistration(127.0.0.1:39791, datanodeUuid=4f3d790e-9a12-4c29-96e0-e4d6d524729e, infoPort=34707, infoSecurePort=0, ipcPort=39901, storageInfo=lv=-57;cid=testClusterID;nsid=1919872256;c=1676840434539), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:35,003 INFO [Listener at localhost/39901] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45035 2023-02-19 21:00:35,010 WARN [Listener at localhost/45159] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:35,110 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8024512aa6295d63: Processing first storage report for DS-091dd200-2c56-48cc-b00f-5b1129704d6d from datanode 5e87785c-ed43-46bc-b23e-57b45fc73f24 2023-02-19 21:00:35,110 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8024512aa6295d63: from storage DS-091dd200-2c56-48cc-b00f-5b1129704d6d node DatanodeRegistration(127.0.0.1:38529, datanodeUuid=5e87785c-ed43-46bc-b23e-57b45fc73f24, infoPort=39399, infoSecurePort=0, ipcPort=45159, storageInfo=lv=-57;cid=testClusterID;nsid=1919872256;c=1676840434539), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:35,110 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8024512aa6295d63: Processing first storage report for DS-e0d27502-1730-4cdb-a671-668c7bf97241 from datanode 5e87785c-ed43-46bc-b23e-57b45fc73f24 2023-02-19 21:00:35,111 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8024512aa6295d63: from storage DS-e0d27502-1730-4cdb-a671-668c7bf97241 node DatanodeRegistration(127.0.0.1:38529, datanodeUuid=5e87785c-ed43-46bc-b23e-57b45fc73f24, infoPort=39399, infoSecurePort=0, ipcPort=45159, storageInfo=lv=-57;cid=testClusterID;nsid=1919872256;c=1676840434539), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:35,119 DEBUG [Listener at localhost/45159] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60 2023-02-19 21:00:35,121 INFO [Listener at localhost/45159] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/cluster_5c4df952-d85b-af76-8d8a-055b52a7d4ba/zookeeper_0, clientPort=56400, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/cluster_5c4df952-d85b-af76-8d8a-055b52a7d4ba/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/cluster_5c4df952-d85b-af76-8d8a-055b52a7d4ba/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 21:00:35,122 INFO [Listener at localhost/45159] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56400 2023-02-19 21:00:35,123 INFO [Listener at localhost/45159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:35,124 INFO [Listener at localhost/45159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:35,156 INFO [Listener at localhost/45159] util.FSUtils(479): Created version file at hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df with version=8 2023-02-19 21:00:35,157 INFO [Listener at localhost/45159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:35,158 INFO [Listener at localhost/45159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:35,159 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39781/user/jenkins/test-data/1d9ece67-5da3-4bfa-54a2-d722fb2ba550/hbase-staging 2023-02-19 21:00:35,161 INFO [Listener at localhost/45159] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:35,161 INFO [Listener at localhost/45159] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:35,162 INFO [Listener at localhost/45159] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:35,162 INFO [Listener at localhost/45159] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:35,162 INFO [Listener at localhost/45159] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:35,162 INFO [Listener at localhost/45159] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:35,162 INFO [Listener at localhost/45159] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:35,163 INFO [Listener at localhost/45159] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35783 2023-02-19 21:00:35,163 INFO [Listener at localhost/45159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:35,164 INFO [Listener at localhost/45159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:35,165 INFO [Listener at localhost/45159] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35783 connecting to ZooKeeper ensemble=127.0.0.1:56400 2023-02-19 21:00:35,174 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:357830x0, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:35,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35783-0x1006e6267750000 connected 2023-02-19 21:00:35,194 DEBUG [Listener at localhost/45159] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:35,194 DEBUG [Listener at localhost/45159] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:35,194 DEBUG [Listener at localhost/45159] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:35,195 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35783 2023-02-19 21:00:35,195 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35783 2023-02-19 21:00:35,196 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35783 2023-02-19 21:00:35,197 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35783 2023-02-19 21:00:35,198 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35783 2023-02-19 21:00:35,198 INFO [Listener at localhost/45159] master.HMaster(444): hbase.rootdir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df, hbase.cluster.distributed=false 2023-02-19 21:00:35,210 INFO [Listener at localhost/45159] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:35,210 INFO [Listener at localhost/45159] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:35,211 INFO [Listener at localhost/45159] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:35,211 INFO [Listener at localhost/45159] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:35,211 INFO [Listener at localhost/45159] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:35,211 INFO [Listener at localhost/45159] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:35,211 INFO [Listener at localhost/45159] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:35,212 INFO [Listener at localhost/45159] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41369 2023-02-19 21:00:35,212 INFO [Listener at localhost/45159] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 21:00:35,216 DEBUG [Listener at localhost/45159] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:35,216 INFO [Listener at localhost/45159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:35,217 INFO [Listener at localhost/45159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:35,218 INFO [Listener at localhost/45159] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41369 connecting to ZooKeeper ensemble=127.0.0.1:56400 2023-02-19 21:00:35,227 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:413690x0, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:35,228 DEBUG [Listener at localhost/45159] zookeeper.ZKUtil(164): regionserver:413690x0, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:35,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41369-0x1006e6267750001 connected 2023-02-19 21:00:35,229 DEBUG [Listener at localhost/45159] zookeeper.ZKUtil(164): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:35,229 DEBUG [Listener at localhost/45159] zookeeper.ZKUtil(164): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:35,230 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41369 2023-02-19 21:00:35,230 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41369 2023-02-19 21:00:35,232 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41369 2023-02-19 21:00:35,236 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41369 2023-02-19 21:00:35,236 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41369 2023-02-19 21:00:35,247 INFO [Listener at localhost/45159] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:35,247 INFO [Listener at localhost/45159] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:35,247 INFO [Listener at localhost/45159] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:35,247 INFO [Listener at localhost/45159] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:35,247 INFO [Listener at localhost/45159] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:35,247 INFO [Listener at localhost/45159] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:35,247 INFO [Listener at localhost/45159] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:35,248 INFO [Listener at localhost/45159] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42147 2023-02-19 21:00:35,248 INFO [Listener at localhost/45159] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 21:00:35,249 DEBUG [Listener at localhost/45159] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:35,249 INFO [Listener at localhost/45159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:35,250 INFO [Listener at localhost/45159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:35,251 INFO [Listener at localhost/45159] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42147 connecting to ZooKeeper ensemble=127.0.0.1:56400 2023-02-19 21:00:35,255 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:421470x0, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:35,256 DEBUG [Listener at localhost/45159] zookeeper.ZKUtil(164): regionserver:421470x0, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:35,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42147-0x1006e6267750002 connected 2023-02-19 21:00:35,257 DEBUG [Listener at localhost/45159] zookeeper.ZKUtil(164): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:35,258 DEBUG [Listener at localhost/45159] zookeeper.ZKUtil(164): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:35,258 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42147 2023-02-19 21:00:35,258 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42147 2023-02-19 21:00:35,258 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42147 2023-02-19 21:00:35,259 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42147 2023-02-19 21:00:35,259 DEBUG [Listener at localhost/45159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42147 2023-02-19 21:00:35,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35783,1676840435161 2023-02-19 21:00:35,261 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 21:00:35,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35783,1676840435161 2023-02-19 21:00:35,264 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:35,264 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:35,264 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:35,264 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:35,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 21:00:35,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 21:00:35,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35783,1676840435161 from backup master directory 2023-02-19 21:00:35,270 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35783,1676840435161 2023-02-19 21:00:35,270 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 21:00:35,270 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:35,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35783,1676840435161 2023-02-19 21:00:35,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/hbase.id with ID: 1cfe76b6-d245-4d1a-84dd-4c78d03a63ea 2023-02-19 21:00:35,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:35,291 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:35,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x451ee01d to 127.0.0.1:56400 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:35,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b739d78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:35,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:35,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 21:00:35,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:35,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/data/master/store-tmp 2023-02-19 21:00:35,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:35,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:35,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:35,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:35,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:35,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:35,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:35,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:35,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/WALs/jenkins-hbase4.apache.org,35783,1676840435161 2023-02-19 21:00:35,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35783%2C1676840435161, suffix=, logDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/WALs/jenkins-hbase4.apache.org,35783,1676840435161, archiveDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/oldWALs, maxLogs=10 2023-02-19 21:00:35,322 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39791,DS-8982258d-5079-41ae-bf98-771dc07ee098,DISK] 2023-02-19 21:00:35,323 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38529,DS-091dd200-2c56-48cc-b00f-5b1129704d6d,DISK] 2023-02-19 21:00:35,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/WALs/jenkins-hbase4.apache.org,35783,1676840435161/jenkins-hbase4.apache.org%2C35783%2C1676840435161.1676840435310 2023-02-19 21:00:35,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39791,DS-8982258d-5079-41ae-bf98-771dc07ee098,DISK], DatanodeInfoWithStorage[127.0.0.1:38529,DS-091dd200-2c56-48cc-b00f-5b1129704d6d,DISK]] 2023-02-19 21:00:35,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:35,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:35,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:35,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:35,325 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:35,326 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 21:00:35,327 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 21:00:35,327 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:35,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:35,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:35,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:35,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:35,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58805934, jitterRate=-0.12372329831123352}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 21:00:35,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:35,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 21:00:35,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 21:00:35,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 21:00:35,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 21:00:35,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 21:00:35,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 21:00:35,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 21:00:35,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 21:00:35,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 21:00:35,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 21:00:35,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 21:00:35,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 21:00:35,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 21:00:35,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 21:00:35,348 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:35,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 21:00:35,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 21:00:35,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 21:00:35,351 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:35,351 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:35,351 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:35,351 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:35,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35783,1676840435161, sessionid=0x1006e6267750000, setting cluster-up flag (Was=false) 2023-02-19 21:00:35,358 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:35,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 21:00:35,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35783,1676840435161 2023-02-19 21:00:35,368 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:35,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 21:00:35,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35783,1676840435161 2023-02-19 21:00:35,375 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.hbase-snapshot/.tmp 2023-02-19 21:00:35,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:35,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:35,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:35,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:35,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:35,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 21:00:35,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:35,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676840465381 2023-02-19 21:00:35,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 21:00:35,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 21:00:35,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 21:00:35,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 21:00:35,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 21:00:35,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 21:00:35,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,382 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:35,382 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 21:00:35,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 21:00:35,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 21:00:35,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 21:00:35,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 21:00:35,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 21:00:35,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840435383,5,FailOnTimeoutGroup] 2023-02-19 21:00:35,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840435383,5,FailOnTimeoutGroup] 2023-02-19 21:00:35,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 21:00:35,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,383 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:35,389 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:35,390 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:35,390 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df 2023-02-19 21:00:35,398 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:35,403 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 21:00:35,404 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/info 2023-02-19 21:00:35,404 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 21:00:35,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:35,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 21:00:35,406 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:35,406 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 21:00:35,406 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:35,407 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 21:00:35,408 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/table 2023-02-19 21:00:35,408 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 21:00:35,408 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:35,409 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740 2023-02-19 21:00:35,410 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740 2023-02-19 21:00:35,411 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 21:00:35,412 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 21:00:35,414 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:35,414 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71672102, jitterRate=0.06799754500389099}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 21:00:35,414 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 21:00:35,414 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:35,414 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:35,414 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:35,414 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:35,414 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:35,415 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:35,415 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:35,415 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:35,415 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 21:00:35,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 21:00:35,417 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 21:00:35,420 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 21:00:35,461 INFO [RS:0;jenkins-hbase4:41369] regionserver.HRegionServer(952): ClusterId : 1cfe76b6-d245-4d1a-84dd-4c78d03a63ea 2023-02-19 21:00:35,462 INFO [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(952): ClusterId : 1cfe76b6-d245-4d1a-84dd-4c78d03a63ea 2023-02-19 21:00:35,462 DEBUG [RS:0;jenkins-hbase4:41369] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 21:00:35,462 DEBUG [RS:1;jenkins-hbase4:42147] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 21:00:35,464 DEBUG [RS:1;jenkins-hbase4:42147] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 21:00:35,464 DEBUG [RS:1;jenkins-hbase4:42147] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 21:00:35,464 DEBUG [RS:0;jenkins-hbase4:41369] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 21:00:35,464 DEBUG [RS:0;jenkins-hbase4:41369] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 21:00:35,470 DEBUG [RS:1;jenkins-hbase4:42147] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 21:00:35,473 DEBUG [RS:1;jenkins-hbase4:42147] zookeeper.ReadOnlyZKClient(139): Connect 0x38eccf6b to 127.0.0.1:56400 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:35,473 DEBUG [RS:0;jenkins-hbase4:41369] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 21:00:35,476 DEBUG [RS:0;jenkins-hbase4:41369] zookeeper.ReadOnlyZKClient(139): Connect 0x5e78f33a to 127.0.0.1:56400 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:35,481 DEBUG [RS:1;jenkins-hbase4:42147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@362b2606, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:35,482 DEBUG [RS:1;jenkins-hbase4:42147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3214a41b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:35,484 DEBUG [RS:0;jenkins-hbase4:41369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50bf1685, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:35,484 DEBUG [RS:0;jenkins-hbase4:41369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5480984a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:35,494 DEBUG [RS:0;jenkins-hbase4:41369] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41369 2023-02-19 21:00:35,494 INFO [RS:0;jenkins-hbase4:41369] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 21:00:35,494 INFO [RS:0;jenkins-hbase4:41369] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 21:00:35,494 DEBUG [RS:0;jenkins-hbase4:41369] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 21:00:35,494 DEBUG [RS:1;jenkins-hbase4:42147] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42147 2023-02-19 21:00:35,495 INFO [RS:1;jenkins-hbase4:42147] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 21:00:35,495 INFO [RS:1;jenkins-hbase4:42147] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 21:00:35,495 DEBUG [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 21:00:35,495 INFO [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35783,1676840435161 with isa=jenkins-hbase4.apache.org/172.31.14.131:42147, startcode=1676840435246 2023-02-19 21:00:35,496 INFO [RS:0;jenkins-hbase4:41369] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35783,1676840435161 with isa=jenkins-hbase4.apache.org/172.31.14.131:41369, startcode=1676840435210 2023-02-19 21:00:35,496 DEBUG [RS:1;jenkins-hbase4:42147] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 21:00:35,496 DEBUG [RS:0;jenkins-hbase4:41369] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 21:00:35,504 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42973, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 21:00:35,505 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49923, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 21:00:35,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:35,507 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35783] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:35,508 DEBUG [RS:0;jenkins-hbase4:41369] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df 2023-02-19 21:00:35,508 DEBUG [RS:0;jenkins-hbase4:41369] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39781 2023-02-19 21:00:35,508 DEBUG [RS:0;jenkins-hbase4:41369] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 21:00:35,510 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:35,510 DEBUG [RS:0;jenkins-hbase4:41369] zookeeper.ZKUtil(162): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:35,511 WARN [RS:0;jenkins-hbase4:41369] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:35,511 INFO [RS:0;jenkins-hbase4:41369] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:35,511 DEBUG [RS:0;jenkins-hbase4:41369] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/WALs/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:35,512 DEBUG [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df 2023-02-19 21:00:35,512 DEBUG [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39781 2023-02-19 21:00:35,512 DEBUG [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 21:00:35,512 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41369,1676840435210] 2023-02-19 21:00:35,515 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:35,516 DEBUG [RS:1;jenkins-hbase4:42147] zookeeper.ZKUtil(162): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:35,516 WARN [RS:1;jenkins-hbase4:42147] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:35,516 INFO [RS:1;jenkins-hbase4:42147] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:35,516 DEBUG [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/WALs/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:35,516 DEBUG [RS:0;jenkins-hbase4:41369] zookeeper.ZKUtil(162): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:35,518 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42147,1676840435246] 2023-02-19 21:00:35,518 DEBUG [RS:0;jenkins-hbase4:41369] zookeeper.ZKUtil(162): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:35,522 DEBUG [RS:0;jenkins-hbase4:41369] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 21:00:35,522 INFO [RS:0;jenkins-hbase4:41369] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 21:00:35,523 DEBUG [RS:1;jenkins-hbase4:42147] zookeeper.ZKUtil(162): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:35,524 INFO [RS:0;jenkins-hbase4:41369] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 21:00:35,524 DEBUG [RS:1;jenkins-hbase4:42147] zookeeper.ZKUtil(162): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:35,525 DEBUG [RS:1;jenkins-hbase4:42147] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 21:00:35,525 INFO [RS:1;jenkins-hbase4:42147] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 21:00:35,528 INFO [RS:0;jenkins-hbase4:41369] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 21:00:35,528 INFO [RS:0;jenkins-hbase4:41369] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,536 INFO [RS:1;jenkins-hbase4:42147] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 21:00:35,536 INFO [RS:0;jenkins-hbase4:41369] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 21:00:35,541 INFO [RS:1;jenkins-hbase4:42147] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 21:00:35,541 INFO [RS:1;jenkins-hbase4:42147] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,544 INFO [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 21:00:35,544 INFO [RS:0;jenkins-hbase4:41369] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,544 DEBUG [RS:0;jenkins-hbase4:41369] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,544 DEBUG [RS:0;jenkins-hbase4:41369] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,544 DEBUG [RS:0;jenkins-hbase4:41369] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,544 DEBUG [RS:0;jenkins-hbase4:41369] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,544 DEBUG [RS:0;jenkins-hbase4:41369] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,544 DEBUG [RS:0;jenkins-hbase4:41369] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:35,544 DEBUG [RS:0;jenkins-hbase4:41369] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,545 DEBUG [RS:0;jenkins-hbase4:41369] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,545 DEBUG [RS:0;jenkins-hbase4:41369] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,545 INFO [RS:1;jenkins-hbase4:42147] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,545 DEBUG [RS:0;jenkins-hbase4:41369] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,545 DEBUG [RS:1;jenkins-hbase4:42147] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,545 DEBUG [RS:1;jenkins-hbase4:42147] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,545 DEBUG [RS:1;jenkins-hbase4:42147] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,545 DEBUG [RS:1;jenkins-hbase4:42147] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,545 DEBUG [RS:1;jenkins-hbase4:42147] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,545 DEBUG [RS:1;jenkins-hbase4:42147] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:35,545 DEBUG [RS:1;jenkins-hbase4:42147] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,545 DEBUG [RS:1;jenkins-hbase4:42147] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,545 DEBUG [RS:1;jenkins-hbase4:42147] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,545 DEBUG [RS:1;jenkins-hbase4:42147] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:35,570 DEBUG [jenkins-hbase4:35783] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 21:00:35,571 DEBUG [jenkins-hbase4:35783] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:35,573 INFO [RS:1;jenkins-hbase4:42147] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,573 INFO [RS:1;jenkins-hbase4:42147] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,573 INFO [RS:1;jenkins-hbase4:42147] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,574 DEBUG [jenkins-hbase4:35783] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:35,574 DEBUG [jenkins-hbase4:35783] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:35,574 DEBUG [jenkins-hbase4:35783] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:35,574 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42147,1676840435246, state=OPENING 2023-02-19 21:00:35,576 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 21:00:35,576 INFO [RS:0;jenkins-hbase4:41369] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,576 INFO [RS:0;jenkins-hbase4:41369] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,576 INFO [RS:0;jenkins-hbase4:41369] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,578 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:35,579 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 21:00:35,582 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42147,1676840435246}] 2023-02-19 21:00:35,592 INFO [RS:1;jenkins-hbase4:42147] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 21:00:35,592 INFO [RS:1;jenkins-hbase4:42147] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42147,1676840435246-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,599 INFO [RS:0;jenkins-hbase4:41369] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 21:00:35,599 INFO [RS:0;jenkins-hbase4:41369] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41369,1676840435210-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,605 INFO [RS:1;jenkins-hbase4:42147] regionserver.Replication(203): jenkins-hbase4.apache.org,42147,1676840435246 started 2023-02-19 21:00:35,605 INFO [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42147,1676840435246, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42147, sessionid=0x1006e6267750002 2023-02-19 21:00:35,605 DEBUG [RS:1;jenkins-hbase4:42147] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 21:00:35,605 DEBUG [RS:1;jenkins-hbase4:42147] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:35,605 DEBUG [RS:1;jenkins-hbase4:42147] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42147,1676840435246' 2023-02-19 21:00:35,606 DEBUG [RS:1;jenkins-hbase4:42147] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:35,606 DEBUG [RS:1;jenkins-hbase4:42147] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:35,606 DEBUG [RS:1;jenkins-hbase4:42147] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 21:00:35,606 DEBUG [RS:1;jenkins-hbase4:42147] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 21:00:35,606 DEBUG [RS:1;jenkins-hbase4:42147] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:35,606 DEBUG [RS:1;jenkins-hbase4:42147] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42147,1676840435246' 2023-02-19 21:00:35,606 DEBUG [RS:1;jenkins-hbase4:42147] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:35,607 DEBUG [RS:1;jenkins-hbase4:42147] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:35,607 DEBUG [RS:1;jenkins-hbase4:42147] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 21:00:35,607 INFO [RS:1;jenkins-hbase4:42147] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 21:00:35,607 INFO [RS:1;jenkins-hbase4:42147] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 21:00:35,614 INFO [RS:0;jenkins-hbase4:41369] regionserver.Replication(203): jenkins-hbase4.apache.org,41369,1676840435210 started 2023-02-19 21:00:35,614 INFO [RS:0;jenkins-hbase4:41369] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41369,1676840435210, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41369, sessionid=0x1006e6267750001 2023-02-19 21:00:35,615 DEBUG [RS:0;jenkins-hbase4:41369] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 21:00:35,615 DEBUG [RS:0;jenkins-hbase4:41369] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:35,615 DEBUG [RS:0;jenkins-hbase4:41369] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41369,1676840435210' 2023-02-19 21:00:35,615 DEBUG [RS:0;jenkins-hbase4:41369] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:35,615 DEBUG [RS:0;jenkins-hbase4:41369] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:35,615 DEBUG [RS:0;jenkins-hbase4:41369] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 21:00:35,615 DEBUG [RS:0;jenkins-hbase4:41369] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 21:00:35,615 DEBUG [RS:0;jenkins-hbase4:41369] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:35,615 DEBUG [RS:0;jenkins-hbase4:41369] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41369,1676840435210' 2023-02-19 21:00:35,615 DEBUG [RS:0;jenkins-hbase4:41369] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:35,616 DEBUG [RS:0;jenkins-hbase4:41369] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:35,616 DEBUG [RS:0;jenkins-hbase4:41369] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 21:00:35,616 INFO [RS:0;jenkins-hbase4:41369] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 21:00:35,616 INFO [RS:0;jenkins-hbase4:41369] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 21:00:35,738 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:35,738 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 21:00:35,740 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37572, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 21:00:35,744 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 21:00:35,744 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:35,746 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42147%2C1676840435246.meta, suffix=.meta, logDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/WALs/jenkins-hbase4.apache.org,42147,1676840435246, archiveDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/oldWALs, maxLogs=32 2023-02-19 21:00:35,782 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39791,DS-8982258d-5079-41ae-bf98-771dc07ee098,DISK] 2023-02-19 21:00:35,783 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38529,DS-091dd200-2c56-48cc-b00f-5b1129704d6d,DISK] 2023-02-19 21:00:35,785 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/WALs/jenkins-hbase4.apache.org,42147,1676840435246/jenkins-hbase4.apache.org%2C42147%2C1676840435246.meta.1676840435746.meta 2023-02-19 21:00:35,788 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39791,DS-8982258d-5079-41ae-bf98-771dc07ee098,DISK], DatanodeInfoWithStorage[127.0.0.1:38529,DS-091dd200-2c56-48cc-b00f-5b1129704d6d,DISK]] 2023-02-19 21:00:35,788 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:35,788 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 21:00:35,789 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 21:00:35,789 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 21:00:35,789 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 21:00:35,789 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:35,789 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 21:00:35,789 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 21:00:35,796 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 21:00:35,797 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/info 2023-02-19 21:00:35,797 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/info 2023-02-19 21:00:35,798 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 21:00:35,798 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:35,798 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 21:00:35,799 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:35,799 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:35,799 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 21:00:35,800 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:35,800 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 21:00:35,801 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/table 2023-02-19 21:00:35,801 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/table 2023-02-19 21:00:35,801 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 21:00:35,802 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:35,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740 2023-02-19 21:00:35,803 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740 2023-02-19 21:00:35,805 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 21:00:35,805 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 21:00:35,806 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60462179, jitterRate=-0.09904332458972931}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 21:00:35,806 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 21:00:35,807 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676840435738 2023-02-19 21:00:35,810 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 21:00:35,811 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 21:00:35,811 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42147,1676840435246, state=OPEN 2023-02-19 21:00:35,813 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 21:00:35,813 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 21:00:35,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 21:00:35,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42147,1676840435246 in 234 msec 2023-02-19 21:00:35,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 21:00:35,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 398 msec 2023-02-19 21:00:35,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 440 msec 2023-02-19 21:00:35,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676840435817, completionTime=-1 2023-02-19 21:00:35,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 21:00:35,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 21:00:35,820 DEBUG [hconnection-0x3e8aedaa-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:35,821 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37584, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:35,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 21:00:35,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676840495822 2023-02-19 21:00:35,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676840555822 2023-02-19 21:00:35,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-19 21:00:35,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35783,1676840435161-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35783,1676840435161-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35783,1676840435161-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35783, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:35,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 21:00:35,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:35,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 21:00:35,830 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 21:00:35,830 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 21:00:35,831 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 21:00:35,832 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa 2023-02-19 21:00:35,832 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa empty. 2023-02-19 21:00:35,833 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa 2023-02-19 21:00:35,833 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 21:00:35,845 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:35,846 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 40c647a296c09ea375ad45c12d94bfaa, NAME => 'hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp 2023-02-19 21:00:35,855 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:35,855 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 40c647a296c09ea375ad45c12d94bfaa, disabling compactions & flushes 2023-02-19 21:00:35,855 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. 2023-02-19 21:00:35,855 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. 2023-02-19 21:00:35,855 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. after waiting 0 ms 2023-02-19 21:00:35,855 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. 2023-02-19 21:00:35,856 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. 2023-02-19 21:00:35,856 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 40c647a296c09ea375ad45c12d94bfaa: 2023-02-19 21:00:35,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 21:00:35,858 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840435858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840435858"}]},"ts":"1676840435858"} 2023-02-19 21:00:35,861 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 21:00:35,862 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 21:00:35,862 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840435862"}]},"ts":"1676840435862"} 2023-02-19 21:00:35,863 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 21:00:35,869 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:35,869 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:35,869 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:35,869 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:35,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=40c647a296c09ea375ad45c12d94bfaa, ASSIGN}] 2023-02-19 21:00:35,872 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=40c647a296c09ea375ad45c12d94bfaa, ASSIGN 2023-02-19 21:00:35,874 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=40c647a296c09ea375ad45c12d94bfaa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42147,1676840435246; forceNewPlan=false, retain=false 2023-02-19 21:00:36,025 INFO [jenkins-hbase4:35783] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 21:00:36,025 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=40c647a296c09ea375ad45c12d94bfaa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:36,025 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840436025"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840436025"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840436025"}]},"ts":"1676840436025"} 2023-02-19 21:00:36,027 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 40c647a296c09ea375ad45c12d94bfaa, server=jenkins-hbase4.apache.org,42147,1676840435246}] 2023-02-19 21:00:36,182 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. 2023-02-19 21:00:36,183 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42147%2C1676840435246, suffix=, logDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/WALs/jenkins-hbase4.apache.org,42147,1676840435246, archiveDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/oldWALs, maxLogs=32 2023-02-19 21:00:36,196 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38529,DS-091dd200-2c56-48cc-b00f-5b1129704d6d,DISK] 2023-02-19 21:00:36,196 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39791,DS-8982258d-5079-41ae-bf98-771dc07ee098,DISK] 2023-02-19 21:00:36,197 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/WALs/jenkins-hbase4.apache.org,42147,1676840435246/jenkins-hbase4.apache.org%2C42147%2C1676840435246.1676840436183 2023-02-19 21:00:36,197 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39791,DS-8982258d-5079-41ae-bf98-771dc07ee098,DISK], DatanodeInfoWithStorage[127.0.0.1:38529,DS-091dd200-2c56-48cc-b00f-5b1129704d6d,DISK]] 2023-02-19 21:00:36,198 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 40c647a296c09ea375ad45c12d94bfaa, NAME => 'hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:36,198 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 40c647a296c09ea375ad45c12d94bfaa 2023-02-19 21:00:36,198 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:36,198 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 40c647a296c09ea375ad45c12d94bfaa 2023-02-19 21:00:36,198 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 40c647a296c09ea375ad45c12d94bfaa 2023-02-19 21:00:36,199 INFO [StoreOpener-40c647a296c09ea375ad45c12d94bfaa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 40c647a296c09ea375ad45c12d94bfaa 2023-02-19 21:00:36,200 DEBUG [StoreOpener-40c647a296c09ea375ad45c12d94bfaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa/info 2023-02-19 21:00:36,200 DEBUG [StoreOpener-40c647a296c09ea375ad45c12d94bfaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa/info 2023-02-19 21:00:36,201 INFO [StoreOpener-40c647a296c09ea375ad45c12d94bfaa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40c647a296c09ea375ad45c12d94bfaa columnFamilyName info 2023-02-19 21:00:36,201 INFO [StoreOpener-40c647a296c09ea375ad45c12d94bfaa-1] regionserver.HStore(310): Store=40c647a296c09ea375ad45c12d94bfaa/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:36,202 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa 2023-02-19 21:00:36,202 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa 2023-02-19 21:00:36,204 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 40c647a296c09ea375ad45c12d94bfaa 2023-02-19 21:00:36,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:36,206 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 40c647a296c09ea375ad45c12d94bfaa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69874547, jitterRate=0.04121188819408417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 21:00:36,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 40c647a296c09ea375ad45c12d94bfaa: 2023-02-19 21:00:36,207 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa., pid=6, masterSystemTime=1676840436179 2023-02-19 21:00:36,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. 2023-02-19 21:00:36,209 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. 2023-02-19 21:00:36,209 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=40c647a296c09ea375ad45c12d94bfaa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:36,210 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840436209"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840436209"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840436209"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840436209"}]},"ts":"1676840436209"} 2023-02-19 21:00:36,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 21:00:36,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 40c647a296c09ea375ad45c12d94bfaa, server=jenkins-hbase4.apache.org,42147,1676840435246 in 184 msec 2023-02-19 21:00:36,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 21:00:36,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=40c647a296c09ea375ad45c12d94bfaa, ASSIGN in 342 msec 2023-02-19 21:00:36,214 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 21:00:36,214 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840436214"}]},"ts":"1676840436214"} 2023-02-19 21:00:36,215 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 21:00:36,217 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 21:00:36,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 389 msec 2023-02-19 21:00:36,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 21:00:36,231 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:36,231 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:36,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 21:00:36,243 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:36,246 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-19 21:00:36,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 21:00:36,262 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:36,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-19 21:00:36,271 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 21:00:36,273 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 21:00:36,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.002sec 2023-02-19 21:00:36,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 21:00:36,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 21:00:36,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 21:00:36,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35783,1676840435161-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 21:00:36,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35783,1676840435161-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 21:00:36,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 21:00:36,362 DEBUG [Listener at localhost/45159] zookeeper.ReadOnlyZKClient(139): Connect 0x0a132988 to 127.0.0.1:56400 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:36,370 DEBUG [Listener at localhost/45159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49aed9ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:36,372 DEBUG [hconnection-0x734288ca-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:36,373 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37600, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:36,374 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35783,1676840435161 2023-02-19 21:00:36,374 DEBUG [Listener at localhost/45159] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 21:00:36,376 DEBUG [Listener at localhost/45159] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 21:00:36,377 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36212, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 21:00:36,378 INFO [Listener at localhost/45159] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-19 21:00:36,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-19 21:00:36,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 21:00:36,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:36212 deadline: 1676840496378, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-19 21:00:36,379 INFO [Listener at localhost/45159] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-19 21:00:36,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:36,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:36,382 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 21:00:36,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-19 21:00:36,383 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 21:00:36,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:36,384 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:36,384 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b empty. 2023-02-19 21:00:36,385 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:36,385 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-19 21:00:36,392 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:36,393 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 62914c09df5fa10a37a8ac5323f5a40b, NAME => 'testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp 2023-02-19 21:00:36,398 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:36,398 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 62914c09df5fa10a37a8ac5323f5a40b, disabling compactions & flushes 2023-02-19 21:00:36,398 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:36,398 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:36,398 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. after waiting 0 ms 2023-02-19 21:00:36,398 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:36,398 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:36,399 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 62914c09df5fa10a37a8ac5323f5a40b: 2023-02-19 21:00:36,400 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 21:00:36,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676840436401"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840436401"}]},"ts":"1676840436401"} 2023-02-19 21:00:36,402 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 21:00:36,402 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 21:00:36,403 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840436402"}]},"ts":"1676840436402"} 2023-02-19 21:00:36,403 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-19 21:00:36,406 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:36,407 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:36,407 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:36,407 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:36,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=62914c09df5fa10a37a8ac5323f5a40b, ASSIGN}] 2023-02-19 21:00:36,409 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=62914c09df5fa10a37a8ac5323f5a40b, ASSIGN 2023-02-19 21:00:36,409 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=62914c09df5fa10a37a8ac5323f5a40b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42147,1676840435246; forceNewPlan=false, retain=false 2023-02-19 21:00:36,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:36,560 INFO [jenkins-hbase4:35783] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 21:00:36,560 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=62914c09df5fa10a37a8ac5323f5a40b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:36,560 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676840436560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840436560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840436560"}]},"ts":"1676840436560"} 2023-02-19 21:00:36,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 62914c09df5fa10a37a8ac5323f5a40b, server=jenkins-hbase4.apache.org,42147,1676840435246}] 2023-02-19 21:00:36,618 INFO [RS:0;jenkins-hbase4:41369] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41369%2C1676840435210, suffix=, logDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/WALs/jenkins-hbase4.apache.org,41369,1676840435210, archiveDir=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/oldWALs, maxLogs=32 2023-02-19 21:00:36,632 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39791,DS-8982258d-5079-41ae-bf98-771dc07ee098,DISK] 2023-02-19 21:00:36,632 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38529,DS-091dd200-2c56-48cc-b00f-5b1129704d6d,DISK] 2023-02-19 21:00:36,634 INFO [RS:0;jenkins-hbase4:41369] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/WALs/jenkins-hbase4.apache.org,41369,1676840435210/jenkins-hbase4.apache.org%2C41369%2C1676840435210.1676840436618 2023-02-19 21:00:36,634 DEBUG [RS:0;jenkins-hbase4:41369] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38529,DS-091dd200-2c56-48cc-b00f-5b1129704d6d,DISK], DatanodeInfoWithStorage[127.0.0.1:39791,DS-8982258d-5079-41ae-bf98-771dc07ee098,DISK]] 2023-02-19 21:00:36,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:36,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:36,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 62914c09df5fa10a37a8ac5323f5a40b, NAME => 'testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:36,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:36,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:36,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:36,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:36,718 INFO [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:36,719 DEBUG [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1 2023-02-19 21:00:36,719 DEBUG [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1 2023-02-19 21:00:36,719 INFO [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62914c09df5fa10a37a8ac5323f5a40b columnFamilyName f1 2023-02-19 21:00:36,720 INFO [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] regionserver.HStore(310): Store=62914c09df5fa10a37a8ac5323f5a40b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:36,720 INFO [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:36,721 DEBUG [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2 2023-02-19 21:00:36,721 DEBUG [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2 2023-02-19 21:00:36,721 INFO [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62914c09df5fa10a37a8ac5323f5a40b columnFamilyName f2 2023-02-19 21:00:36,722 INFO [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] regionserver.HStore(310): Store=62914c09df5fa10a37a8ac5323f5a40b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:36,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:36,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:36,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:36,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:36,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:36,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 62914c09df5fa10a37a8ac5323f5a40b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63290708, jitterRate=-0.05689495801925659}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:36,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 62914c09df5fa10a37a8ac5323f5a40b: 2023-02-19 21:00:36,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b., pid=12, masterSystemTime=1676840436713 2023-02-19 21:00:36,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:36,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:36,729 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=62914c09df5fa10a37a8ac5323f5a40b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:36,729 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676840436729"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840436729"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840436729"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840436729"}]},"ts":"1676840436729"} 2023-02-19 21:00:36,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-19 21:00:36,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 62914c09df5fa10a37a8ac5323f5a40b, server=jenkins-hbase4.apache.org,42147,1676840435246 in 168 msec 2023-02-19 21:00:36,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-19 21:00:36,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=62914c09df5fa10a37a8ac5323f5a40b, ASSIGN in 325 msec 2023-02-19 21:00:36,734 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 21:00:36,734 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840436734"}]},"ts":"1676840436734"} 2023-02-19 21:00:36,735 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-19 21:00:36,737 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 21:00:36,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 356 msec 2023-02-19 21:00:36,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:36,987 INFO [Listener at localhost/45159] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-19 21:00:36,988 DEBUG [Listener at localhost/45159] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-19 21:00:36,988 INFO [Listener at localhost/45159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 21:00:36,990 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-19 21:00:36,990 INFO [Listener at localhost/45159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 21:00:36,990 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-19 21:00:36,990 INFO [Listener at localhost/45159] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 21:00:37,033 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42147] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,127 INFO [Listener at localhost/45159] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 21:00:37,128 INFO [Listener at localhost/45159] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 21:00:37,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-19 21:00:37,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676840437128 (current time:1676840437128). 2023-02-19 21:00:37,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 21:00:37,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] zookeeper.ReadOnlyZKClient(139): Connect 0x310adc6e to 127.0.0.1:56400 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:37,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67f6ddea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:37,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:37,134 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37604, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:37,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x310adc6e to 127.0.0.1:56400 2023-02-19 21:00:37,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:37,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 21:00:37,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-19 21:00:37,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-19 21:00:37,138 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-19 21:00:37,138 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676841037138 2023-02-19 21:00:37,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-19 21:00:37,139 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,140 DEBUG [Listener at localhost/45159] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:37,140 DEBUG [Listener at localhost/45159] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 21:00:37,140 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-19 21:00:37,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-19 21:00:37,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-19 21:00:37,142 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-19 21:00:37,142 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676841037142 2023-02-19 21:00:37,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,150 INFO [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-19 21:00:37,150 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:37,151 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-19 21:00:37,151 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-19 21:00:37,151 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,151 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,152 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:37,152 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:37,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:37,152 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:37,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:37,153 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,153 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-19 21:00:37,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-19 21:00:37,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,154 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-19 21:00:37,154 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-19 21:00:37,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,154 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-19 21:00:37,154 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:37,154 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-19 21:00:37,155 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 21:00:37,155 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:37,155 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-19 21:00:37,155 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42147,1676840435246' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-19 21:00:37,156 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 21:00:37,156 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-19 21:00:37,156 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41369,1676840435210' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-19 21:00:37,158 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,158 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,158 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:37,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:37,158 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,158 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:37,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:37,158 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:37,159 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:37,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42147,1676840435246' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-19 21:00:37,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@349874e8[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:37,160 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-19 21:00:37,160 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,162 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,162 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,162 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 21:00:37,162 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 21:00:37,162 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,162 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:37,162 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-19 21:00:37,162 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41369,1676840435210' in zk 2023-02-19 21:00:37,163 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-19 21:00:37,163 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 21:00:37,163 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,163 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. started... 2023-02-19 21:00:37,163 INFO [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 62914c09df5fa10a37a8ac5323f5a40b 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-19 21:00:37,166 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-19 21:00:37,166 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:37,166 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-19 21:00:37,180 INFO [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/.tmp/f1/f88fb930925b47d2bfdbe000383a0574 2023-02-19 21:00:37,202 INFO [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/.tmp/f2/da28dca8a1c24f5e81382fa217f50ef5 2023-02-19 21:00:37,207 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/.tmp/f1/f88fb930925b47d2bfdbe000383a0574 as hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1/f88fb930925b47d2bfdbe000383a0574 2023-02-19 21:00:37,211 INFO [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1/f88fb930925b47d2bfdbe000383a0574, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 21:00:37,214 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/.tmp/f2/da28dca8a1c24f5e81382fa217f50ef5 as hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2/da28dca8a1c24f5e81382fa217f50ef5 2023-02-19 21:00:37,219 INFO [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2/da28dca8a1c24f5e81382fa217f50ef5, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 21:00:37,220 INFO [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 62914c09df5fa10a37a8ac5323f5a40b in 57ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:37,220 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-19 21:00:37,221 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 62914c09df5fa10a37a8ac5323f5a40b: 2023-02-19 21:00:37,221 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,221 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:37,221 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1/f88fb930925b47d2bfdbe000383a0574] hfiles 2023-02-19 21:00:37,221 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1/f88fb930925b47d2bfdbe000383a0574 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,221 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2/da28dca8a1c24f5e81382fa217f50ef5] hfiles 2023-02-19 21:00:37,221 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2/da28dca8a1c24f5e81382fa217f50ef5 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,230 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. completed. 2023-02-19 21:00:37,230 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,230 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-19 21:00:37,230 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-19 21:00:37,230 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,230 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-19 21:00:37,230 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,42147,1676840435246' in zk 2023-02-19 21:00:37,232 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,232 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-19 21:00:37,232 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:37,232 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-19 21:00:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:37,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,42147,1676840435246': 2023-02-19 21:00:37,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42147,1676840435246' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-19 21:00:37,237 INFO [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-19 21:00:37,237 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:37,237 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:37,237 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,237 INFO [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 21:00:37,240 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,240 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,240 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,240 DEBUG [Listener at localhost/45159] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:37,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,240 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:37,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:37,240 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:37,241 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:37,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-19 21:00:37,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:37,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 21:00:37,242 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,242 DEBUG [Listener at localhost/45159] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 21:00:37,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:37,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,244 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,244 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:37,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,254 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,254 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:37,254 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:37,254 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:37,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion because node does not exist (not an error) 2023-02-19 21:00:37,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:37,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:37,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:37,254 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:37,254 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,254 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:37,254 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:37,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:37,254 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:37,254 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:37,254 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,255 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,255 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,255 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,255 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,285 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-19 21:00:37,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,285 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676840437139Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676840437254 (+115 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676840437254Writing data manifest for testWithMockedMapReduceSingleRegion at 1676840437257 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676840437265 (+8 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676840437285 (+20 ms) 2023-02-19 21:00:37,287 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-19 21:00:37,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 147 msec 2023-02-19 21:00:37,442 DEBUG [Listener at localhost/45159] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:37,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-19 21:00:37,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 21:00:37,444 INFO [Listener at localhost/45159] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 21:00:37,448 INFO [Listener at localhost/45159] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 21:00:37,453 INFO [Listener at localhost/45159] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 21:00:37,547 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42147] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,673 INFO [Listener at localhost/45159] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 21:00:37,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 21:00:37,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,681 INFO [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-19 21:00:37,681 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:37,682 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-19 21:00:37,682 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-19 21:00:37,683 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,683 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,684 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:37,684 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:37,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:37,684 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:37,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:37,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:37,685 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,685 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:37,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:37,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,686 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:37,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,686 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,687 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-19 21:00:37,687 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:37,687 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-19 21:00:37,688 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:37,688 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 21:00:37,689 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 21:00:37,689 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-19 21:00:37,689 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41369,1676840435210' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-19 21:00:37,689 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-19 21:00:37,689 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 21:00:37,690 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,690 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. started... 2023-02-19 21:00:37,690 INFO [rs(jenkins-hbase4.apache.org,42147,1676840435246)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 62914c09df5fa10a37a8ac5323f5a40b 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-19 21:00:37,691 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,692 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,692 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:37,705 INFO [rs(jenkins-hbase4.apache.org,42147,1676840435246)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/.tmp/f1/a8887c6291ce4181b8e3c578194e12b1 2023-02-19 21:00:37,722 INFO [rs(jenkins-hbase4.apache.org,42147,1676840435246)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/.tmp/f2/47be0903739340c4a157029bfd2a3f6e 2023-02-19 21:00:37,726 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/.tmp/f1/a8887c6291ce4181b8e3c578194e12b1 as hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1/a8887c6291ce4181b8e3c578194e12b1 2023-02-19 21:00:37,730 INFO [rs(jenkins-hbase4.apache.org,42147,1676840435246)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1/a8887c6291ce4181b8e3c578194e12b1, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 21:00:37,731 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/.tmp/f2/47be0903739340c4a157029bfd2a3f6e as hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2/47be0903739340c4a157029bfd2a3f6e 2023-02-19 21:00:37,735 INFO [rs(jenkins-hbase4.apache.org,42147,1676840435246)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2/47be0903739340c4a157029bfd2a3f6e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 21:00:37,736 INFO [rs(jenkins-hbase4.apache.org,42147,1676840435246)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 62914c09df5fa10a37a8ac5323f5a40b in 46ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:37,737 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 62914c09df5fa10a37a8ac5323f5a40b: 2023-02-19 21:00:37,737 DEBUG [rs(jenkins-hbase4.apache.org,42147,1676840435246)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,737 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-19 21:00:37,737 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-19 21:00:37,737 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,737 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-19 21:00:37,737 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42147,1676840435246' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-19 21:00:37,738 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,738 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:37,739 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,739 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:37,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42147,1676840435246' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-19 21:00:37,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30a7f6a3[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:37,740 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-19 21:00:37,740 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,742 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,742 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,742 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 21:00:37,742 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-19 21:00:37,742 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,743 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41369,1676840435210' in zk 2023-02-19 21:00:37,742 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 21:00:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-19 21:00:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,42147,1676840435246' in zk 2023-02-19 21:00:37,744 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-19 21:00:37,744 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:37,744 DEBUG [member: 'jenkins-hbase4.apache.org,41369,1676840435210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-19 21:00:37,745 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-19 21:00:37,745 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:37,745 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,745 DEBUG [member: 'jenkins-hbase4.apache.org,42147,1676840435246' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-19 21:00:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:37,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,42147,1676840435246': 2023-02-19 21:00:37,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42147,1676840435246' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-19 21:00:37,747 INFO [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-19 21:00:37,747 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:37,747 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:37,747 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,747 INFO [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 21:00:37,749 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,749 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,749 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:37,749 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:37,749 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:37,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:37,750 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:37,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:37,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:37,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:37,750 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:37,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:37,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,751 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,752 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:37,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,755 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:37,756 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:37,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:37,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:37,756 DEBUG [(jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:37,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:37,756 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:37,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-19 21:00:37,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 21:00:37,756 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:37,756 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:37,756 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:37,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:37,756 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,756 DEBUG [Listener at localhost/45159] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:37,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:37,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:37,756 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,756 DEBUG [Listener at localhost/45159] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 21:00:37,757 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:37,757 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,757 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,757 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,757 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,857 DEBUG [Listener at localhost/45159] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 21:00:37,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 21:00:37,861 INFO [Listener at localhost/45159] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676840437128 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:37,861 DEBUG [Listener at localhost/45159] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39781/user/jenkins/test-data/1d9ece67-5da3-4bfa-54a2-d722fb2ba550/testWithMockedMapReduceSingleRegion/4d51046c-4c85-48c2-86b8-27c77342e539/data/default/testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,862 INFO [Listener at localhost/45159] snapshot.RestoreSnapshotHelper(239): region to add: 62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:37,862 INFO [Listener at localhost/45159] snapshot.RestoreSnapshotHelper(585): clone region=62914c09df5fa10a37a8ac5323f5a40b as 62914c09df5fa10a37a8ac5323f5a40b in snapshot testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,862 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 62914c09df5fa10a37a8ac5323f5a40b, NAME => 'testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39781/user/jenkins/test-data/1d9ece67-5da3-4bfa-54a2-d722fb2ba550/testWithMockedMapReduceSingleRegion/4d51046c-4c85-48c2-86b8-27c77342e539 2023-02-19 21:00:37,868 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:37,868 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f88fb930925b47d2bfdbe000383a0574 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,870 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink da28dca8a1c24f5e81382fa217f50ef5 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,871 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 62914c09df5fa10a37a8ac5323f5a40b, disabling compactions & flushes 2023-02-19 21:00:37,871 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,872 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,872 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. after waiting 0 ms 2023-02-19 21:00:37,872 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,872 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,872 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 62914c09df5fa10a37a8ac5323f5a40b: 2023-02-19 21:00:37,872 INFO [Listener at localhost/45159] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676840437128 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:37,872 DEBUG [Listener at localhost/45159] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39781/user/jenkins/test-data/1d9ece67-5da3-4bfa-54a2-d722fb2ba550/testWithMockedMapReduceSingleRegion/4d51046c-4c85-48c2-86b8-27c77342e539 2023-02-19 21:00:37,872 DEBUG [Listener at localhost/45159] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39781/user/jenkins/test-data/1d9ece67-5da3-4bfa-54a2-d722fb2ba550/testWithMockedMapReduceSingleRegion/4d51046c-4c85-48c2-86b8-27c77342e539 2023-02-19 21:00:37,872 DEBUG [Listener at localhost/45159] util.CommonFSUtils(699): |-data/ 2023-02-19 21:00:37,873 DEBUG [Listener at localhost/45159] util.CommonFSUtils(699): |----default/ 2023-02-19 21:00:37,873 DEBUG [Listener at localhost/45159] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-19 21:00:37,873 DEBUG [Listener at localhost/45159] util.CommonFSUtils(699): |----------62914c09df5fa10a37a8ac5323f5a40b/ 2023-02-19 21:00:37,873 DEBUG [Listener at localhost/45159] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:37,874 DEBUG [Listener at localhost/45159] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:37,874 DEBUG [Listener at localhost/45159] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=62914c09df5fa10a37a8ac5323f5a40b-f88fb930925b47d2bfdbe000383a0574 2023-02-19 21:00:37,874 DEBUG [Listener at localhost/45159] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:37,874 DEBUG [Listener at localhost/45159] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=62914c09df5fa10a37a8ac5323f5a40b-da28dca8a1c24f5e81382fa217f50ef5 2023-02-19 21:00:37,877 INFO [Listener at localhost/45159] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 21:00:37,880 DEBUG [Listener at localhost/45159] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:37,880 INFO [Listener at localhost/45159] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:37,881 DEBUG [Listener at localhost/45159] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:37,883 INFO [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:37,884 DEBUG [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/1d9ece67-5da3-4bfa-54a2-d722fb2ba550/testWithMockedMapReduceSingleRegion/4d51046c-4c85-48c2-86b8-27c77342e539/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1 2023-02-19 21:00:37,884 INFO [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62914c09df5fa10a37a8ac5323f5a40b columnFamilyName f1 2023-02-19 21:00:37,887 DEBUG [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] regionserver.HStore(539): loaded hdfs://localhost:39781/user/jenkins/test-data/1d9ece67-5da3-4bfa-54a2-d722fb2ba550/testWithMockedMapReduceSingleRegion/4d51046c-4c85-48c2-86b8-27c77342e539/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1/testWithMockedMapReduceSingleRegion=62914c09df5fa10a37a8ac5323f5a40b-f88fb930925b47d2bfdbe000383a0574 2023-02-19 21:00:37,887 INFO [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] regionserver.HStore(310): Store=62914c09df5fa10a37a8ac5323f5a40b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:37,887 INFO [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:37,888 DEBUG [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39781/user/jenkins/test-data/1d9ece67-5da3-4bfa-54a2-d722fb2ba550/testWithMockedMapReduceSingleRegion/4d51046c-4c85-48c2-86b8-27c77342e539/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2 2023-02-19 21:00:37,888 INFO [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62914c09df5fa10a37a8ac5323f5a40b columnFamilyName f2 2023-02-19 21:00:37,892 DEBUG [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] regionserver.HStore(539): loaded hdfs://localhost:39781/user/jenkins/test-data/1d9ece67-5da3-4bfa-54a2-d722fb2ba550/testWithMockedMapReduceSingleRegion/4d51046c-4c85-48c2-86b8-27c77342e539/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2/testWithMockedMapReduceSingleRegion=62914c09df5fa10a37a8ac5323f5a40b-da28dca8a1c24f5e81382fa217f50ef5 2023-02-19 21:00:37,892 INFO [StoreOpener-62914c09df5fa10a37a8ac5323f5a40b-1] regionserver.HStore(310): Store=62914c09df5fa10a37a8ac5323f5a40b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:37,892 DEBUG [Listener at localhost/45159] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:37,892 INFO [Listener at localhost/45159] regionserver.HRegion(1071): Opened 62914c09df5fa10a37a8ac5323f5a40b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67796906, jitterRate=0.010252624750137329}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:37,892 DEBUG [Listener at localhost/45159] regionserver.HRegion(964): Region open journal for 62914c09df5fa10a37a8ac5323f5a40b: 2023-02-19 21:00:37,939 DEBUG [Listener at localhost/45159] regionserver.HRegion(1603): Closing 62914c09df5fa10a37a8ac5323f5a40b, disabling compactions & flushes 2023-02-19 21:00:37,939 INFO [Listener at localhost/45159] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,939 DEBUG [Listener at localhost/45159] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,939 DEBUG [Listener at localhost/45159] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. after waiting 0 ms 2023-02-19 21:00:37,939 DEBUG [Listener at localhost/45159] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,940 INFO [Listener at localhost/45159] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:37,940 DEBUG [Listener at localhost/45159] regionserver.HRegion(1557): Region close journal for 62914c09df5fa10a37a8ac5323f5a40b: 2023-02-19 21:00:37,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-19 21:00:37,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,947 INFO [Listener at localhost/45159] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:37,951 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840437950"}]},"ts":"1676840437950"} 2023-02-19 21:00:37,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 21:00:37,952 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-19 21:00:37,953 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-19 21:00:37,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=62914c09df5fa10a37a8ac5323f5a40b, UNASSIGN}] 2023-02-19 21:00:37,955 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=62914c09df5fa10a37a8ac5323f5a40b, UNASSIGN 2023-02-19 21:00:37,955 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=62914c09df5fa10a37a8ac5323f5a40b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:37,956 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676840437955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840437955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840437955"}]},"ts":"1676840437955"} 2023-02-19 21:00:37,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 62914c09df5fa10a37a8ac5323f5a40b, server=jenkins-hbase4.apache.org,42147,1676840435246}] 2023-02-19 21:00:38,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 21:00:38,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:38,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 62914c09df5fa10a37a8ac5323f5a40b, disabling compactions & flushes 2023-02-19 21:00:38,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:38,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:38,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. after waiting 0 ms 2023-02-19 21:00:38,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:38,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:38,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b. 2023-02-19 21:00:38,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 62914c09df5fa10a37a8ac5323f5a40b: 2023-02-19 21:00:38,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:38,117 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=62914c09df5fa10a37a8ac5323f5a40b, regionState=CLOSED 2023-02-19 21:00:38,117 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676840438117"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840438117"}]},"ts":"1676840438117"} 2023-02-19 21:00:38,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-19 21:00:38,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 62914c09df5fa10a37a8ac5323f5a40b, server=jenkins-hbase4.apache.org,42147,1676840435246 in 161 msec 2023-02-19 21:00:38,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-19 21:00:38,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=62914c09df5fa10a37a8ac5323f5a40b, UNASSIGN in 165 msec 2023-02-19 21:00:38,121 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840438121"}]},"ts":"1676840438121"} 2023-02-19 21:00:38,122 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-19 21:00:38,124 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-19 21:00:38,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 176 msec 2023-02-19 21:00:38,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 21:00:38,254 INFO [Listener at localhost/45159] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-19 21:00:38,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-19 21:00:38,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:38,257 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:38,258 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:38,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 21:00:38,261 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:38,262 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2, FileablePath, hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/recovered.edits] 2023-02-19 21:00:38,265 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1/a8887c6291ce4181b8e3c578194e12b1 to hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/archive/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1/a8887c6291ce4181b8e3c578194e12b1 2023-02-19 21:00:38,266 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1/f88fb930925b47d2bfdbe000383a0574 to hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/archive/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f1/f88fb930925b47d2bfdbe000383a0574 2023-02-19 21:00:38,268 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2/47be0903739340c4a157029bfd2a3f6e to hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/archive/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2/47be0903739340c4a157029bfd2a3f6e 2023-02-19 21:00:38,269 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2/da28dca8a1c24f5e81382fa217f50ef5 to hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/archive/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/f2/da28dca8a1c24f5e81382fa217f50ef5 2023-02-19 21:00:38,271 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/recovered.edits/12.seqid to hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/archive/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b/recovered.edits/12.seqid 2023-02-19 21:00:38,272 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/.tmp/data/default/testWithMockedMapReduceSingleRegion/62914c09df5fa10a37a8ac5323f5a40b 2023-02-19 21:00:38,272 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-19 21:00:38,274 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:38,275 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-19 21:00:38,276 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-19 21:00:38,277 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:38,277 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-19 21:00:38,277 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840438277"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:38,278 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-19 21:00:38,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 62914c09df5fa10a37a8ac5323f5a40b, NAME => 'testWithMockedMapReduceSingleRegion,,1676840436380.62914c09df5fa10a37a8ac5323f5a40b.', STARTKEY => '', ENDKEY => ''}] 2023-02-19 21:00:38,278 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-19 21:00:38,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676840438278"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:38,279 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-19 21:00:38,281 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 21:00:38,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 26 msec 2023-02-19 21:00:38,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 21:00:38,360 INFO [Listener at localhost/45159] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-19 21:00:38,360 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 21:00:38,360 INFO [Listener at localhost/45159] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 21:00:38,360 DEBUG [Listener at localhost/45159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a132988 to 127.0.0.1:56400 2023-02-19 21:00:38,360 DEBUG [Listener at localhost/45159] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:38,360 DEBUG [Listener at localhost/45159] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 21:00:38,360 DEBUG [Listener at localhost/45159] util.JVMClusterUtil(257): Found active master hash=720847000, stopped=false 2023-02-19 21:00:38,360 INFO [Listener at localhost/45159] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35783,1676840435161 2023-02-19 21:00:38,364 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:38,364 INFO [Listener at localhost/45159] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 21:00:38,364 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:38,364 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:38,364 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:38,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:38,365 DEBUG [Listener at localhost/45159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x451ee01d to 127.0.0.1:56400 2023-02-19 21:00:38,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:38,366 DEBUG [Listener at localhost/45159] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:38,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:38,366 INFO [Listener at localhost/45159] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41369,1676840435210' ***** 2023-02-19 21:00:38,366 INFO [Listener at localhost/45159] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:38,366 INFO [Listener at localhost/45159] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42147,1676840435246' ***** 2023-02-19 21:00:38,366 INFO [Listener at localhost/45159] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:38,366 INFO [RS:0;jenkins-hbase4:41369] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:38,366 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:38,366 INFO [RS:0;jenkins-hbase4:41369] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:38,367 INFO [RS:1;jenkins-hbase4:42147] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:38,367 INFO [RS:0;jenkins-hbase4:41369] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:38,367 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:38,367 INFO [RS:0;jenkins-hbase4:41369] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:38,367 INFO [RS:1;jenkins-hbase4:42147] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:38,367 DEBUG [RS:0;jenkins-hbase4:41369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e78f33a to 127.0.0.1:56400 2023-02-19 21:00:38,368 INFO [RS:1;jenkins-hbase4:42147] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:38,368 DEBUG [RS:0;jenkins-hbase4:41369] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:38,368 INFO [RS:0;jenkins-hbase4:41369] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41369,1676840435210; all regions closed. 2023-02-19 21:00:38,368 INFO [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(3304): Received CLOSE for 40c647a296c09ea375ad45c12d94bfaa 2023-02-19 21:00:38,368 INFO [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:38,368 DEBUG [RS:1;jenkins-hbase4:42147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38eccf6b to 127.0.0.1:56400 2023-02-19 21:00:38,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 40c647a296c09ea375ad45c12d94bfaa, disabling compactions & flushes 2023-02-19 21:00:38,368 DEBUG [RS:1;jenkins-hbase4:42147] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:38,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. 2023-02-19 21:00:38,369 INFO [RS:1;jenkins-hbase4:42147] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:38,369 INFO [RS:1;jenkins-hbase4:42147] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:38,369 INFO [RS:1;jenkins-hbase4:42147] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:38,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. 2023-02-19 21:00:38,369 INFO [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 21:00:38,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. after waiting 0 ms 2023-02-19 21:00:38,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. 2023-02-19 21:00:38,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 40c647a296c09ea375ad45c12d94bfaa 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 21:00:38,369 INFO [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-19 21:00:38,369 DEBUG [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 40c647a296c09ea375ad45c12d94bfaa=hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa.} 2023-02-19 21:00:38,369 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:38,369 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:38,369 DEBUG [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1505): Waiting on 1588230740, 40c647a296c09ea375ad45c12d94bfaa 2023-02-19 21:00:38,369 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:38,369 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:38,369 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:38,369 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-19 21:00:38,372 DEBUG [RS:0;jenkins-hbase4:41369] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/oldWALs 2023-02-19 21:00:38,372 INFO [RS:0;jenkins-hbase4:41369] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41369%2C1676840435210:(num 1676840436618) 2023-02-19 21:00:38,372 DEBUG [RS:0;jenkins-hbase4:41369] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:38,372 INFO [RS:0;jenkins-hbase4:41369] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:38,372 INFO [RS:0;jenkins-hbase4:41369] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:38,372 INFO [RS:0;jenkins-hbase4:41369] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:38,372 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:38,372 INFO [RS:0;jenkins-hbase4:41369] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:38,372 INFO [RS:0;jenkins-hbase4:41369] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:38,373 INFO [RS:0;jenkins-hbase4:41369] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41369 2023-02-19 21:00:38,375 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:38,375 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:38,375 ERROR [Listener at localhost/45159-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7754d2a0 rejected from java.util.concurrent.ThreadPoolExecutor@736b5892[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:38,375 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:38,375 ERROR [Listener at localhost/45159-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5605f197 rejected from java.util.concurrent.ThreadPoolExecutor@736b5892[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:38,376 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41369,1676840435210 2023-02-19 21:00:38,376 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:38,376 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41369,1676840435210] 2023-02-19 21:00:38,376 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41369,1676840435210; numProcessing=1 2023-02-19 21:00:38,377 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41369,1676840435210 already deleted, retry=false 2023-02-19 21:00:38,377 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41369,1676840435210 expired; onlineServers=1 2023-02-19 21:00:38,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa/.tmp/info/38ba8570454341adac16ef4b54e7a446 2023-02-19 21:00:38,381 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/.tmp/info/620cb3ead9fd43efa33420fe92360adf 2023-02-19 21:00:38,385 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 620cb3ead9fd43efa33420fe92360adf 2023-02-19 21:00:38,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa/.tmp/info/38ba8570454341adac16ef4b54e7a446 as hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa/info/38ba8570454341adac16ef4b54e7a446 2023-02-19 21:00:38,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa/info/38ba8570454341adac16ef4b54e7a446, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 21:00:38,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 40c647a296c09ea375ad45c12d94bfaa in 20ms, sequenceid=6, compaction requested=false 2023-02-19 21:00:38,392 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/.tmp/rep_barrier/bbbabe52742949da9279afed1d535e77 2023-02-19 21:00:38,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/namespace/40c647a296c09ea375ad45c12d94bfaa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 21:00:38,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. 2023-02-19 21:00:38,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 40c647a296c09ea375ad45c12d94bfaa: 2023-02-19 21:00:38,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676840435828.40c647a296c09ea375ad45c12d94bfaa. 2023-02-19 21:00:38,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bbbabe52742949da9279afed1d535e77 2023-02-19 21:00:38,413 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:38,413 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:38,542 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 21:00:38,563 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:38,563 INFO [RS:0;jenkins-hbase4:41369] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41369,1676840435210; zookeeper connection closed. 2023-02-19 21:00:38,563 ERROR [Listener at localhost/45159-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e939f9d rejected from java.util.concurrent.ThreadPoolExecutor@736b5892[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:38,566 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2d545146] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2d545146 2023-02-19 21:00:38,566 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:41369-0x1006e6267750001, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:38,566 ERROR [Listener at localhost/45159-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2fb6fdc2 rejected from java.util.concurrent.ThreadPoolExecutor@736b5892[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:38,569 DEBUG [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 21:00:38,631 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 21:00:38,631 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 21:00:38,770 DEBUG [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 21:00:38,804 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/.tmp/table/434bc688c91041ffa84d2f51ba370db1 2023-02-19 21:00:38,808 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 434bc688c91041ffa84d2f51ba370db1 2023-02-19 21:00:38,809 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/.tmp/info/620cb3ead9fd43efa33420fe92360adf as hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/info/620cb3ead9fd43efa33420fe92360adf 2023-02-19 21:00:38,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 620cb3ead9fd43efa33420fe92360adf 2023-02-19 21:00:38,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/info/620cb3ead9fd43efa33420fe92360adf, entries=12, sequenceid=21, filesize=6.3 K 2023-02-19 21:00:38,813 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/.tmp/rep_barrier/bbbabe52742949da9279afed1d535e77 as hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/rep_barrier/bbbabe52742949da9279afed1d535e77 2023-02-19 21:00:38,816 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bbbabe52742949da9279afed1d535e77 2023-02-19 21:00:38,816 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/rep_barrier/bbbabe52742949da9279afed1d535e77, entries=1, sequenceid=21, filesize=5.0 K 2023-02-19 21:00:38,817 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/.tmp/table/434bc688c91041ffa84d2f51ba370db1 as hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/table/434bc688c91041ffa84d2f51ba370db1 2023-02-19 21:00:38,821 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 434bc688c91041ffa84d2f51ba370db1 2023-02-19 21:00:38,821 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/table/434bc688c91041ffa84d2f51ba370db1, entries=4, sequenceid=21, filesize=5.1 K 2023-02-19 21:00:38,824 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 455ms, sequenceid=21, compaction requested=false 2023-02-19 21:00:38,827 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-19 21:00:38,827 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 21:00:38,828 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:38,828 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:38,828 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:38,970 INFO [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42147,1676840435246; all regions closed. 2023-02-19 21:00:38,973 DEBUG [RS:1;jenkins-hbase4:42147] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/oldWALs 2023-02-19 21:00:38,974 INFO [RS:1;jenkins-hbase4:42147] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42147%2C1676840435246.meta:.meta(num 1676840435746) 2023-02-19 21:00:38,977 DEBUG [RS:1;jenkins-hbase4:42147] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/oldWALs 2023-02-19 21:00:38,977 INFO [RS:1;jenkins-hbase4:42147] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42147%2C1676840435246:(num 1676840436183) 2023-02-19 21:00:38,977 DEBUG [RS:1;jenkins-hbase4:42147] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:38,977 INFO [RS:1;jenkins-hbase4:42147] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:38,977 INFO [RS:1;jenkins-hbase4:42147] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:38,977 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:38,978 INFO [RS:1;jenkins-hbase4:42147] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42147 2023-02-19 21:00:38,985 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:38,985 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42147,1676840435246 2023-02-19 21:00:38,985 ERROR [Listener at localhost/45159-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@683d7c90 rejected from java.util.concurrent.ThreadPoolExecutor@6c02f54f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:38,986 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42147,1676840435246] 2023-02-19 21:00:38,986 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42147,1676840435246; numProcessing=2 2023-02-19 21:00:38,987 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42147,1676840435246 already deleted, retry=false 2023-02-19 21:00:38,987 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42147,1676840435246 expired; onlineServers=0 2023-02-19 21:00:38,987 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35783,1676840435161' ***** 2023-02-19 21:00:38,987 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 21:00:38,988 DEBUG [M:0;jenkins-hbase4:35783] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ec8c11e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:38,988 INFO [M:0;jenkins-hbase4:35783] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35783,1676840435161 2023-02-19 21:00:38,989 INFO [M:0;jenkins-hbase4:35783] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35783,1676840435161; all regions closed. 2023-02-19 21:00:38,989 DEBUG [M:0;jenkins-hbase4:35783] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:38,989 DEBUG [M:0;jenkins-hbase4:35783] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 21:00:38,989 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 21:00:38,989 DEBUG [M:0;jenkins-hbase4:35783] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 21:00:38,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840435383] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840435383,5,FailOnTimeoutGroup] 2023-02-19 21:00:38,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840435383] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840435383,5,FailOnTimeoutGroup] 2023-02-19 21:00:38,989 INFO [M:0;jenkins-hbase4:35783] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 21:00:38,990 INFO [M:0;jenkins-hbase4:35783] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 21:00:38,990 INFO [M:0;jenkins-hbase4:35783] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 21:00:38,990 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:38,990 DEBUG [M:0;jenkins-hbase4:35783] master.HMaster(1512): Stopping service threads 2023-02-19 21:00:38,990 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:38,990 INFO [M:0;jenkins-hbase4:35783] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 21:00:38,991 ERROR [M:0;jenkins-hbase4:35783] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 21:00:38,991 INFO [M:0;jenkins-hbase4:35783] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 21:00:38,991 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 21:00:38,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:38,991 DEBUG [M:0;jenkins-hbase4:35783] zookeeper.ZKUtil(398): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 21:00:38,991 WARN [M:0;jenkins-hbase4:35783] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 21:00:38,991 INFO [M:0;jenkins-hbase4:35783] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 21:00:38,992 INFO [M:0;jenkins-hbase4:35783] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 21:00:38,992 DEBUG [M:0;jenkins-hbase4:35783] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:38,992 INFO [M:0;jenkins-hbase4:35783] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:38,992 DEBUG [M:0;jenkins-hbase4:35783] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:38,992 DEBUG [M:0;jenkins-hbase4:35783] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:38,992 DEBUG [M:0;jenkins-hbase4:35783] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:38,992 INFO [M:0;jenkins-hbase4:35783] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.10 KB heapSize=67.06 KB 2023-02-19 21:00:39,001 INFO [M:0;jenkins-hbase4:35783] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.10 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/be69f89da261447c979e74905210fc01 2023-02-19 21:00:39,004 DEBUG [M:0;jenkins-hbase4:35783] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/be69f89da261447c979e74905210fc01 as hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/be69f89da261447c979e74905210fc01 2023-02-19 21:00:39,008 INFO [M:0;jenkins-hbase4:35783] regionserver.HStore(1080): Added hdfs://localhost:39781/user/jenkins/test-data/4cb77fba-1285-ea8d-9086-24147771e5df/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/be69f89da261447c979e74905210fc01, entries=17, sequenceid=132, filesize=8.7 K 2023-02-19 21:00:39,008 INFO [M:0;jenkins-hbase4:35783] regionserver.HRegion(2947): Finished flush of dataSize ~56.10 KB/57443, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-19 21:00:39,009 INFO [M:0;jenkins-hbase4:35783] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:39,009 DEBUG [M:0;jenkins-hbase4:35783] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:39,013 INFO [M:0;jenkins-hbase4:35783] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 21:00:39,013 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:39,013 INFO [M:0;jenkins-hbase4:35783] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35783 2023-02-19 21:00:39,020 DEBUG [M:0;jenkins-hbase4:35783] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35783,1676840435161 already deleted, retry=false 2023-02-19 21:00:39,087 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:39,087 INFO [RS:1;jenkins-hbase4:42147] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42147,1676840435246; zookeeper connection closed. 2023-02-19 21:00:39,087 ERROR [Listener at localhost/45159-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b391ed2 rejected from java.util.concurrent.ThreadPoolExecutor@6c02f54f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:39,087 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): regionserver:42147-0x1006e6267750002, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:39,087 ERROR [Listener at localhost/45159-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@63b00e17 rejected from java.util.concurrent.ThreadPoolExecutor@6c02f54f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:39,087 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@11d9cbe4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@11d9cbe4 2023-02-19 21:00:39,088 INFO [Listener at localhost/45159] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 21:00:39,187 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:39,187 INFO [M:0;jenkins-hbase4:35783] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35783,1676840435161; zookeeper connection closed. 2023-02-19 21:00:39,187 ERROR [Listener at localhost/45159-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@79524373 rejected from java.util.concurrent.ThreadPoolExecutor@7d6dc881[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:39,188 DEBUG [Listener at localhost/45159-EventThread] zookeeper.ZKWatcher(600): master:35783-0x1006e6267750000, quorum=127.0.0.1:56400, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:39,188 ERROR [Listener at localhost/45159-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62bfef9f rejected from java.util.concurrent.ThreadPoolExecutor@7d6dc881[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:39,188 WARN [Listener at localhost/45159] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:39,191 INFO [Listener at localhost/45159] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:39,296 WARN [BP-402037167-172.31.14.131-1676840434539 heartbeating to localhost/127.0.0.1:39781] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:39,296 WARN [BP-402037167-172.31.14.131-1676840434539 heartbeating to localhost/127.0.0.1:39781] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-402037167-172.31.14.131-1676840434539 (Datanode Uuid 5e87785c-ed43-46bc-b23e-57b45fc73f24) service to localhost/127.0.0.1:39781 2023-02-19 21:00:39,297 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/cluster_5c4df952-d85b-af76-8d8a-055b52a7d4ba/dfs/data/data3/current/BP-402037167-172.31.14.131-1676840434539] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:39,297 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/cluster_5c4df952-d85b-af76-8d8a-055b52a7d4ba/dfs/data/data4/current/BP-402037167-172.31.14.131-1676840434539] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:39,298 WARN [Listener at localhost/45159] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:39,303 INFO [Listener at localhost/45159] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:39,306 WARN [BP-402037167-172.31.14.131-1676840434539 heartbeating to localhost/127.0.0.1:39781] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:39,307 WARN [BP-402037167-172.31.14.131-1676840434539 heartbeating to localhost/127.0.0.1:39781] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-402037167-172.31.14.131-1676840434539 (Datanode Uuid 4f3d790e-9a12-4c29-96e0-e4d6d524729e) service to localhost/127.0.0.1:39781 2023-02-19 21:00:39,310 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/cluster_5c4df952-d85b-af76-8d8a-055b52a7d4ba/dfs/data/data1/current/BP-402037167-172.31.14.131-1676840434539] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:39,311 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/cluster_5c4df952-d85b-af76-8d8a-055b52a7d4ba/dfs/data/data2/current/BP-402037167-172.31.14.131-1676840434539] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:39,324 INFO [Listener at localhost/45159] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:39,436 INFO [Listener at localhost/45159] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 21:00:39,450 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 21:00:39,462 INFO [Listener at localhost/45159] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=250 (was 227) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:39781 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39781 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45159.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,35783,1676840435161)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:39781 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:39781 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45159 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:39781 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:39781 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:39781 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=642 (was 616) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=294 (was 311), ProcessCount=170 (was 170), AvailableMemoryMB=8869 (was 8989) 2023-02-19 21:00:39,473 INFO [Listener at localhost/45159] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=250, OpenFileDescriptor=642, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=170, AvailableMemoryMB=8869 2023-02-19 21:00:39,483 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/hadoop.log.dir so I do NOT create it in target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd 2023-02-19 21:00:39,483 WARN [Listener at localhost/45159] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 21:00:39,483 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/hadoop.tmp.dir so I do NOT create it in target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd 2023-02-19 21:00:39,483 WARN [Listener at localhost/45159] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5b226ae-15f6-9586-8320-1208b2f9cc60/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 21:00:39,483 DEBUG [Listener at localhost/45159] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd 2023-02-19 21:00:39,483 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 21:00:39,483 INFO [Listener at localhost/45159] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/cluster_9c4f15a4-1fa7-7759-fc4c-225dcd0be016, deleteOnExit=true 2023-02-19 21:00:39,484 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 21:00:39,484 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/test.cache.data in system properties and HBase conf 2023-02-19 21:00:39,484 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 21:00:39,484 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/hadoop.log.dir in system properties and HBase conf 2023-02-19 21:00:39,484 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 21:00:39,484 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 21:00:39,484 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 21:00:39,484 DEBUG [Listener at localhost/45159] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 21:00:39,484 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 21:00:39,485 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 21:00:39,485 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 21:00:39,485 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 21:00:39,485 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 21:00:39,485 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 21:00:39,485 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 21:00:39,485 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 21:00:39,485 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 21:00:39,485 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/nfs.dump.dir in system properties and HBase conf 2023-02-19 21:00:39,485 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/java.io.tmpdir in system properties and HBase conf 2023-02-19 21:00:39,485 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 21:00:39,485 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 21:00:39,486 INFO [Listener at localhost/45159] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 21:00:39,490 WARN [Listener at localhost/45159] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 21:00:39,490 WARN [Listener at localhost/45159] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 21:00:39,527 WARN [Listener at localhost/45159] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:39,529 INFO [Listener at localhost/45159] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:39,535 INFO [Listener at localhost/45159] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/java.io.tmpdir/Jetty_localhost_46309_hdfs____.gp23rw/webapp 2023-02-19 21:00:39,629 INFO [Listener at localhost/45159] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46309 2023-02-19 21:00:39,633 WARN [Listener at localhost/45159] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 21:00:39,633 WARN [Listener at localhost/45159] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 21:00:39,668 WARN [Listener at localhost/34591] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:39,678 WARN [Listener at localhost/34591] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 21:00:39,680 WARN [Listener at localhost/34591] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:39,681 INFO [Listener at localhost/34591] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:39,686 INFO [Listener at localhost/34591] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/java.io.tmpdir/Jetty_localhost_40153_datanode____.iagah2/webapp 2023-02-19 21:00:39,792 INFO [Listener at localhost/34591] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40153 2023-02-19 21:00:39,800 WARN [Listener at localhost/34747] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:39,813 WARN [Listener at localhost/34747] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 21:00:39,815 WARN [Listener at localhost/34747] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:39,817 INFO [Listener at localhost/34747] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:39,821 INFO [Listener at localhost/34747] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/java.io.tmpdir/Jetty_localhost_39283_datanode____p8zgmm/webapp 2023-02-19 21:00:39,893 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe502a97d610da06d: Processing first storage report for DS-2beffe5d-0d8c-4231-b9bf-2fa662a5e00d from datanode 59a628e6-1533-40cd-b464-cd2682f2f673 2023-02-19 21:00:39,893 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe502a97d610da06d: from storage DS-2beffe5d-0d8c-4231-b9bf-2fa662a5e00d node DatanodeRegistration(127.0.0.1:43793, datanodeUuid=59a628e6-1533-40cd-b464-cd2682f2f673, infoPort=37521, infoSecurePort=0, ipcPort=34747, storageInfo=lv=-57;cid=testClusterID;nsid=424263952;c=1676840439492), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:39,893 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe502a97d610da06d: Processing first storage report for DS-863bd191-e5cc-42ac-a2f4-f899292f61a7 from datanode 59a628e6-1533-40cd-b464-cd2682f2f673 2023-02-19 21:00:39,894 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe502a97d610da06d: from storage DS-863bd191-e5cc-42ac-a2f4-f899292f61a7 node DatanodeRegistration(127.0.0.1:43793, datanodeUuid=59a628e6-1533-40cd-b464-cd2682f2f673, infoPort=37521, infoSecurePort=0, ipcPort=34747, storageInfo=lv=-57;cid=testClusterID;nsid=424263952;c=1676840439492), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:39,940 INFO [Listener at localhost/34747] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39283 2023-02-19 21:00:39,948 WARN [Listener at localhost/41083] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:40,041 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x19b352a48657109: Processing first storage report for DS-f3ee981c-be9c-49c7-8179-441d5e33aa63 from datanode 2f467b09-118c-4f73-8b94-6d23dd7f2322 2023-02-19 21:00:40,041 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x19b352a48657109: from storage DS-f3ee981c-be9c-49c7-8179-441d5e33aa63 node DatanodeRegistration(127.0.0.1:40557, datanodeUuid=2f467b09-118c-4f73-8b94-6d23dd7f2322, infoPort=39643, infoSecurePort=0, ipcPort=41083, storageInfo=lv=-57;cid=testClusterID;nsid=424263952;c=1676840439492), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:40,041 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x19b352a48657109: Processing first storage report for DS-63ce54d7-dc7d-4b64-a294-cedd42566bff from datanode 2f467b09-118c-4f73-8b94-6d23dd7f2322 2023-02-19 21:00:40,041 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x19b352a48657109: from storage DS-63ce54d7-dc7d-4b64-a294-cedd42566bff node DatanodeRegistration(127.0.0.1:40557, datanodeUuid=2f467b09-118c-4f73-8b94-6d23dd7f2322, infoPort=39643, infoSecurePort=0, ipcPort=41083, storageInfo=lv=-57;cid=testClusterID;nsid=424263952;c=1676840439492), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:40,056 DEBUG [Listener at localhost/41083] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd 2023-02-19 21:00:40,058 INFO [Listener at localhost/41083] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/cluster_9c4f15a4-1fa7-7759-fc4c-225dcd0be016/zookeeper_0, clientPort=59090, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/cluster_9c4f15a4-1fa7-7759-fc4c-225dcd0be016/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/cluster_9c4f15a4-1fa7-7759-fc4c-225dcd0be016/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 21:00:40,059 INFO [Listener at localhost/41083] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59090 2023-02-19 21:00:40,059 INFO [Listener at localhost/41083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:40,060 INFO [Listener at localhost/41083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:40,078 INFO [Listener at localhost/41083] util.FSUtils(479): Created version file at hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5 with version=8 2023-02-19 21:00:40,078 INFO [Listener at localhost/41083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:40,079 INFO [Listener at localhost/41083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:40,080 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34591/user/jenkins/test-data/f23c8640-207f-9af8-f57b-34457d478fad/hbase-staging 2023-02-19 21:00:40,082 INFO [Listener at localhost/41083] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:40,082 INFO [Listener at localhost/41083] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:40,082 INFO [Listener at localhost/41083] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:40,082 INFO [Listener at localhost/41083] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:40,082 INFO [Listener at localhost/41083] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:40,082 INFO [Listener at localhost/41083] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:40,082 INFO [Listener at localhost/41083] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:40,083 INFO [Listener at localhost/41083] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38201 2023-02-19 21:00:40,084 INFO [Listener at localhost/41083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:40,084 INFO [Listener at localhost/41083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:40,085 INFO [Listener at localhost/41083] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38201 connecting to ZooKeeper ensemble=127.0.0.1:59090 2023-02-19 21:00:40,092 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:382010x0, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:40,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38201-0x1006e627abf0000 connected 2023-02-19 21:00:40,119 DEBUG [Listener at localhost/41083] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:40,120 DEBUG [Listener at localhost/41083] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:40,120 DEBUG [Listener at localhost/41083] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:40,121 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38201 2023-02-19 21:00:40,121 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38201 2023-02-19 21:00:40,121 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38201 2023-02-19 21:00:40,126 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38201 2023-02-19 21:00:40,126 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38201 2023-02-19 21:00:40,126 INFO [Listener at localhost/41083] master.HMaster(444): hbase.rootdir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5, hbase.cluster.distributed=false 2023-02-19 21:00:40,140 INFO [Listener at localhost/41083] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:40,140 INFO [Listener at localhost/41083] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:40,140 INFO [Listener at localhost/41083] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:40,140 INFO [Listener at localhost/41083] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:40,140 INFO [Listener at localhost/41083] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:40,140 INFO [Listener at localhost/41083] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:40,140 INFO [Listener at localhost/41083] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:40,141 INFO [Listener at localhost/41083] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39213 2023-02-19 21:00:40,141 INFO [Listener at localhost/41083] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 21:00:40,142 DEBUG [Listener at localhost/41083] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:40,143 INFO [Listener at localhost/41083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:40,144 INFO [Listener at localhost/41083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:40,145 INFO [Listener at localhost/41083] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39213 connecting to ZooKeeper ensemble=127.0.0.1:59090 2023-02-19 21:00:40,148 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:392130x0, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:40,148 DEBUG [Listener at localhost/41083] zookeeper.ZKUtil(164): regionserver:392130x0, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:40,149 DEBUG [Listener at localhost/41083] zookeeper.ZKUtil(164): regionserver:392130x0, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:40,149 DEBUG [Listener at localhost/41083] zookeeper.ZKUtil(164): regionserver:392130x0, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:40,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39213-0x1006e627abf0001 connected 2023-02-19 21:00:40,153 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39213 2023-02-19 21:00:40,153 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39213 2023-02-19 21:00:40,156 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39213 2023-02-19 21:00:40,164 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39213 2023-02-19 21:00:40,164 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39213 2023-02-19 21:00:40,175 INFO [Listener at localhost/41083] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:40,175 INFO [Listener at localhost/41083] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:40,176 INFO [Listener at localhost/41083] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:40,176 INFO [Listener at localhost/41083] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:40,176 INFO [Listener at localhost/41083] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:40,176 INFO [Listener at localhost/41083] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:40,176 INFO [Listener at localhost/41083] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:40,177 INFO [Listener at localhost/41083] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43911 2023-02-19 21:00:40,178 INFO [Listener at localhost/41083] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 21:00:40,178 DEBUG [Listener at localhost/41083] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:40,179 INFO [Listener at localhost/41083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:40,179 INFO [Listener at localhost/41083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:40,180 INFO [Listener at localhost/41083] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43911 connecting to ZooKeeper ensemble=127.0.0.1:59090 2023-02-19 21:00:40,183 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:439110x0, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:40,184 DEBUG [Listener at localhost/41083] zookeeper.ZKUtil(164): regionserver:439110x0, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:40,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43911-0x1006e627abf0002 connected 2023-02-19 21:00:40,185 DEBUG [Listener at localhost/41083] zookeeper.ZKUtil(164): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:40,185 DEBUG [Listener at localhost/41083] zookeeper.ZKUtil(164): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:40,186 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43911 2023-02-19 21:00:40,186 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43911 2023-02-19 21:00:40,186 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43911 2023-02-19 21:00:40,186 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43911 2023-02-19 21:00:40,186 DEBUG [Listener at localhost/41083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43911 2023-02-19 21:00:40,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38201,1676840440081 2023-02-19 21:00:40,189 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 21:00:40,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38201,1676840440081 2023-02-19 21:00:40,190 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:40,190 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:40,190 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:40,190 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:40,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 21:00:40,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38201,1676840440081 from backup master directory 2023-02-19 21:00:40,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 21:00:40,193 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38201,1676840440081 2023-02-19 21:00:40,193 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 21:00:40,193 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:40,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38201,1676840440081 2023-02-19 21:00:40,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/hbase.id with ID: fa3a713b-33d5-4848-bd49-ee50c2367070 2023-02-19 21:00:40,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:40,213 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:40,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7940d220 to 127.0.0.1:59090 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:40,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f318cdd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:40,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:40,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 21:00:40,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:40,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/data/master/store-tmp 2023-02-19 21:00:40,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:40,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:40,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:40,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:40,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:40,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:40,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:40,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:40,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/WALs/jenkins-hbase4.apache.org,38201,1676840440081 2023-02-19 21:00:40,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38201%2C1676840440081, suffix=, logDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/WALs/jenkins-hbase4.apache.org,38201,1676840440081, archiveDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/oldWALs, maxLogs=10 2023-02-19 21:00:40,245 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40557,DS-f3ee981c-be9c-49c7-8179-441d5e33aa63,DISK] 2023-02-19 21:00:40,246 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43793,DS-2beffe5d-0d8c-4231-b9bf-2fa662a5e00d,DISK] 2023-02-19 21:00:40,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/WALs/jenkins-hbase4.apache.org,38201,1676840440081/jenkins-hbase4.apache.org%2C38201%2C1676840440081.1676840440233 2023-02-19 21:00:40,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40557,DS-f3ee981c-be9c-49c7-8179-441d5e33aa63,DISK], DatanodeInfoWithStorage[127.0.0.1:43793,DS-2beffe5d-0d8c-4231-b9bf-2fa662a5e00d,DISK]] 2023-02-19 21:00:40,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:40,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:40,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:40,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:40,250 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:40,250 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 21:00:40,251 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 21:00:40,251 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:40,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:40,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:40,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:40,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:40,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66737584, jitterRate=-0.005532503128051758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 21:00:40,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:40,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 21:00:40,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 21:00:40,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 21:00:40,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 21:00:40,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 21:00:40,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 21:00:40,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 21:00:40,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 21:00:40,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 21:00:40,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 21:00:40,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 21:00:40,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 21:00:40,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 21:00:40,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 21:00:40,270 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:40,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 21:00:40,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 21:00:40,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 21:00:40,273 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:40,273 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:40,273 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:40,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38201,1676840440081, sessionid=0x1006e627abf0000, setting cluster-up flag (Was=false) 2023-02-19 21:00:40,276 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:40,278 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:40,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 21:00:40,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38201,1676840440081 2023-02-19 21:00:40,287 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:40,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 21:00:40,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38201,1676840440081 2023-02-19 21:00:40,293 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.hbase-snapshot/.tmp 2023-02-19 21:00:40,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:40,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:40,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:40,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:40,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:40,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 21:00:40,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:40,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676840470304 2023-02-19 21:00:40,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 21:00:40,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 21:00:40,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 21:00:40,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 21:00:40,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 21:00:40,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 21:00:40,305 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:40,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,305 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 21:00:40,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 21:00:40,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 21:00:40,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 21:00:40,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 21:00:40,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 21:00:40,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840440306,5,FailOnTimeoutGroup] 2023-02-19 21:00:40,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840440306,5,FailOnTimeoutGroup] 2023-02-19 21:00:40,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 21:00:40,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,307 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:40,314 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:40,314 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:40,314 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5 2023-02-19 21:00:40,319 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:40,320 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 21:00:40,321 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/info 2023-02-19 21:00:40,321 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 21:00:40,321 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:40,322 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 21:00:40,322 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:40,323 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 21:00:40,323 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:40,323 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 21:00:40,324 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/table 2023-02-19 21:00:40,324 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 21:00:40,324 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:40,325 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740 2023-02-19 21:00:40,325 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740 2023-02-19 21:00:40,326 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 21:00:40,327 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 21:00:40,328 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:40,329 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75296863, jitterRate=0.12201069295406342}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 21:00:40,329 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 21:00:40,329 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:40,329 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:40,329 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:40,329 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:40,329 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:40,329 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:40,329 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:40,330 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:40,330 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 21:00:40,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 21:00:40,331 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 21:00:40,332 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 21:00:40,389 INFO [RS:1;jenkins-hbase4:43911] regionserver.HRegionServer(952): ClusterId : fa3a713b-33d5-4848-bd49-ee50c2367070 2023-02-19 21:00:40,389 INFO [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(952): ClusterId : fa3a713b-33d5-4848-bd49-ee50c2367070 2023-02-19 21:00:40,389 DEBUG [RS:1;jenkins-hbase4:43911] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 21:00:40,389 DEBUG [RS:0;jenkins-hbase4:39213] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 21:00:40,391 DEBUG [RS:1;jenkins-hbase4:43911] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 21:00:40,391 DEBUG [RS:0;jenkins-hbase4:39213] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 21:00:40,391 DEBUG [RS:0;jenkins-hbase4:39213] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 21:00:40,391 DEBUG [RS:1;jenkins-hbase4:43911] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 21:00:40,393 DEBUG [RS:0;jenkins-hbase4:39213] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 21:00:40,393 DEBUG [RS:1;jenkins-hbase4:43911] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 21:00:40,394 DEBUG [RS:0;jenkins-hbase4:39213] zookeeper.ReadOnlyZKClient(139): Connect 0x54594bb9 to 127.0.0.1:59090 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:40,394 DEBUG [RS:1;jenkins-hbase4:43911] zookeeper.ReadOnlyZKClient(139): Connect 0x1c5d6585 to 127.0.0.1:59090 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:40,399 DEBUG [RS:1;jenkins-hbase4:43911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@129a887e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:40,399 DEBUG [RS:0;jenkins-hbase4:39213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a9ebf42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:40,399 DEBUG [RS:1;jenkins-hbase4:43911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16a50ef5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:40,399 DEBUG [RS:0;jenkins-hbase4:39213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ea120c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:40,408 DEBUG [RS:0;jenkins-hbase4:39213] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39213 2023-02-19 21:00:40,408 DEBUG [RS:1;jenkins-hbase4:43911] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43911 2023-02-19 21:00:40,408 INFO [RS:0;jenkins-hbase4:39213] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 21:00:40,408 INFO [RS:1;jenkins-hbase4:43911] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 21:00:40,409 INFO [RS:1;jenkins-hbase4:43911] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 21:00:40,408 INFO [RS:0;jenkins-hbase4:39213] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 21:00:40,409 DEBUG [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 21:00:40,409 DEBUG [RS:1;jenkins-hbase4:43911] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 21:00:40,409 INFO [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38201,1676840440081 with isa=jenkins-hbase4.apache.org/172.31.14.131:39213, startcode=1676840440139 2023-02-19 21:00:40,409 INFO [RS:1;jenkins-hbase4:43911] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38201,1676840440081 with isa=jenkins-hbase4.apache.org/172.31.14.131:43911, startcode=1676840440175 2023-02-19 21:00:40,409 DEBUG [RS:0;jenkins-hbase4:39213] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 21:00:40,409 DEBUG [RS:1;jenkins-hbase4:43911] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 21:00:40,411 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43765, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 21:00:40,411 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50599, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 21:00:40,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38201] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:40,413 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:40,414 DEBUG [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5 2023-02-19 21:00:40,414 DEBUG [RS:1;jenkins-hbase4:43911] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5 2023-02-19 21:00:40,414 DEBUG [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34591 2023-02-19 21:00:40,414 DEBUG [RS:1;jenkins-hbase4:43911] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34591 2023-02-19 21:00:40,414 DEBUG [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 21:00:40,414 DEBUG [RS:1;jenkins-hbase4:43911] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 21:00:40,418 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:40,418 DEBUG [RS:1;jenkins-hbase4:43911] zookeeper.ZKUtil(162): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:40,418 DEBUG [RS:0;jenkins-hbase4:39213] zookeeper.ZKUtil(162): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:40,418 WARN [RS:1;jenkins-hbase4:43911] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:40,418 WARN [RS:0;jenkins-hbase4:39213] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:40,419 INFO [RS:1;jenkins-hbase4:43911] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:40,419 INFO [RS:0;jenkins-hbase4:39213] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:40,419 DEBUG [RS:1;jenkins-hbase4:43911] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/WALs/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:40,419 DEBUG [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/WALs/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:40,419 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43911,1676840440175] 2023-02-19 21:00:40,419 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39213,1676840440139] 2023-02-19 21:00:40,423 DEBUG [RS:0;jenkins-hbase4:39213] zookeeper.ZKUtil(162): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:40,423 DEBUG [RS:1;jenkins-hbase4:43911] zookeeper.ZKUtil(162): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:40,424 DEBUG [RS:0;jenkins-hbase4:39213] zookeeper.ZKUtil(162): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:40,424 DEBUG [RS:1;jenkins-hbase4:43911] zookeeper.ZKUtil(162): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:40,424 DEBUG [RS:0;jenkins-hbase4:39213] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 21:00:40,424 DEBUG [RS:1;jenkins-hbase4:43911] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 21:00:40,424 INFO [RS:0;jenkins-hbase4:39213] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 21:00:40,425 INFO [RS:1;jenkins-hbase4:43911] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 21:00:40,426 INFO [RS:0;jenkins-hbase4:39213] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 21:00:40,426 INFO [RS:0;jenkins-hbase4:39213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 21:00:40,426 INFO [RS:0;jenkins-hbase4:39213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,426 INFO [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 21:00:40,427 INFO [RS:1;jenkins-hbase4:43911] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 21:00:40,428 INFO [RS:0;jenkins-hbase4:39213] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,428 INFO [RS:1;jenkins-hbase4:43911] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 21:00:40,428 INFO [RS:1;jenkins-hbase4:43911] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,428 DEBUG [RS:0;jenkins-hbase4:39213] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,428 DEBUG [RS:0;jenkins-hbase4:39213] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,428 INFO [RS:1;jenkins-hbase4:43911] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 21:00:40,428 DEBUG [RS:0;jenkins-hbase4:39213] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,429 DEBUG [RS:0;jenkins-hbase4:39213] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,429 DEBUG [RS:0;jenkins-hbase4:39213] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,429 DEBUG [RS:0;jenkins-hbase4:39213] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:40,429 DEBUG [RS:0;jenkins-hbase4:39213] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,429 DEBUG [RS:0;jenkins-hbase4:39213] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,429 DEBUG [RS:0;jenkins-hbase4:39213] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,429 DEBUG [RS:0;jenkins-hbase4:39213] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,430 INFO [RS:0;jenkins-hbase4:39213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,430 INFO [RS:1;jenkins-hbase4:43911] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,430 INFO [RS:0;jenkins-hbase4:39213] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,431 DEBUG [RS:1;jenkins-hbase4:43911] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,431 INFO [RS:0;jenkins-hbase4:39213] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,431 DEBUG [RS:1;jenkins-hbase4:43911] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,431 DEBUG [RS:1;jenkins-hbase4:43911] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,431 DEBUG [RS:1;jenkins-hbase4:43911] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,431 DEBUG [RS:1;jenkins-hbase4:43911] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,431 DEBUG [RS:1;jenkins-hbase4:43911] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:40,431 DEBUG [RS:1;jenkins-hbase4:43911] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,431 DEBUG [RS:1;jenkins-hbase4:43911] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,431 DEBUG [RS:1;jenkins-hbase4:43911] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,431 DEBUG [RS:1;jenkins-hbase4:43911] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:40,434 INFO [RS:1;jenkins-hbase4:43911] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,434 INFO [RS:1;jenkins-hbase4:43911] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,434 INFO [RS:1;jenkins-hbase4:43911] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,445 INFO [RS:1;jenkins-hbase4:43911] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 21:00:40,445 INFO [RS:1;jenkins-hbase4:43911] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43911,1676840440175-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,447 INFO [RS:0;jenkins-hbase4:39213] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 21:00:40,447 INFO [RS:0;jenkins-hbase4:39213] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39213,1676840440139-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,458 INFO [RS:1;jenkins-hbase4:43911] regionserver.Replication(203): jenkins-hbase4.apache.org,43911,1676840440175 started 2023-02-19 21:00:40,458 INFO [RS:1;jenkins-hbase4:43911] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43911,1676840440175, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43911, sessionid=0x1006e627abf0002 2023-02-19 21:00:40,458 DEBUG [RS:1;jenkins-hbase4:43911] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 21:00:40,458 DEBUG [RS:1;jenkins-hbase4:43911] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:40,458 DEBUG [RS:1;jenkins-hbase4:43911] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43911,1676840440175' 2023-02-19 21:00:40,458 DEBUG [RS:1;jenkins-hbase4:43911] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:40,459 DEBUG [RS:1;jenkins-hbase4:43911] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:40,459 DEBUG [RS:1;jenkins-hbase4:43911] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 21:00:40,459 DEBUG [RS:1;jenkins-hbase4:43911] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 21:00:40,459 DEBUG [RS:1;jenkins-hbase4:43911] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:40,459 DEBUG [RS:1;jenkins-hbase4:43911] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43911,1676840440175' 2023-02-19 21:00:40,459 DEBUG [RS:1;jenkins-hbase4:43911] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:40,459 DEBUG [RS:1;jenkins-hbase4:43911] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:40,460 DEBUG [RS:1;jenkins-hbase4:43911] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 21:00:40,460 INFO [RS:1;jenkins-hbase4:43911] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 21:00:40,460 INFO [RS:1;jenkins-hbase4:43911] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 21:00:40,464 INFO [RS:0;jenkins-hbase4:39213] regionserver.Replication(203): jenkins-hbase4.apache.org,39213,1676840440139 started 2023-02-19 21:00:40,464 INFO [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39213,1676840440139, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39213, sessionid=0x1006e627abf0001 2023-02-19 21:00:40,464 DEBUG [RS:0;jenkins-hbase4:39213] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 21:00:40,464 DEBUG [RS:0;jenkins-hbase4:39213] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:40,464 DEBUG [RS:0;jenkins-hbase4:39213] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39213,1676840440139' 2023-02-19 21:00:40,464 DEBUG [RS:0;jenkins-hbase4:39213] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:40,464 DEBUG [RS:0;jenkins-hbase4:39213] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:40,465 DEBUG [RS:0;jenkins-hbase4:39213] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 21:00:40,465 DEBUG [RS:0;jenkins-hbase4:39213] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 21:00:40,465 DEBUG [RS:0;jenkins-hbase4:39213] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:40,465 DEBUG [RS:0;jenkins-hbase4:39213] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39213,1676840440139' 2023-02-19 21:00:40,465 DEBUG [RS:0;jenkins-hbase4:39213] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:40,465 DEBUG [RS:0;jenkins-hbase4:39213] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:40,466 DEBUG [RS:0;jenkins-hbase4:39213] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 21:00:40,466 INFO [RS:0;jenkins-hbase4:39213] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 21:00:40,466 INFO [RS:0;jenkins-hbase4:39213] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 21:00:40,483 DEBUG [jenkins-hbase4:38201] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 21:00:40,483 DEBUG [jenkins-hbase4:38201] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:40,484 DEBUG [jenkins-hbase4:38201] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:40,484 DEBUG [jenkins-hbase4:38201] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:40,484 DEBUG [jenkins-hbase4:38201] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:40,485 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39213,1676840440139, state=OPENING 2023-02-19 21:00:40,486 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 21:00:40,487 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:40,487 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 21:00:40,487 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39213,1676840440139}] 2023-02-19 21:00:40,642 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:40,643 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 21:00:40,644 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52814, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 21:00:40,648 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 21:00:40,648 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:40,649 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39213%2C1676840440139.meta, suffix=.meta, logDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/WALs/jenkins-hbase4.apache.org,39213,1676840440139, archiveDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/oldWALs, maxLogs=32 2023-02-19 21:00:40,662 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40557,DS-f3ee981c-be9c-49c7-8179-441d5e33aa63,DISK] 2023-02-19 21:00:40,662 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43793,DS-2beffe5d-0d8c-4231-b9bf-2fa662a5e00d,DISK] 2023-02-19 21:00:40,664 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/WALs/jenkins-hbase4.apache.org,39213,1676840440139/jenkins-hbase4.apache.org%2C39213%2C1676840440139.meta.1676840440649.meta 2023-02-19 21:00:40,664 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40557,DS-f3ee981c-be9c-49c7-8179-441d5e33aa63,DISK], DatanodeInfoWithStorage[127.0.0.1:43793,DS-2beffe5d-0d8c-4231-b9bf-2fa662a5e00d,DISK]] 2023-02-19 21:00:40,664 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:40,664 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 21:00:40,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 21:00:40,665 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 21:00:40,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 21:00:40,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:40,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 21:00:40,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 21:00:40,666 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 21:00:40,667 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/info 2023-02-19 21:00:40,667 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/info 2023-02-19 21:00:40,668 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 21:00:40,668 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:40,668 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 21:00:40,669 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:40,669 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:40,669 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 21:00:40,670 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:40,670 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 21:00:40,670 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/table 2023-02-19 21:00:40,671 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/table 2023-02-19 21:00:40,671 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 21:00:40,671 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:40,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740 2023-02-19 21:00:40,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740 2023-02-19 21:00:40,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 21:00:40,675 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 21:00:40,676 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75161261, jitterRate=0.11999006569385529}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 21:00:40,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 21:00:40,679 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676840440642 2023-02-19 21:00:40,683 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 21:00:40,683 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 21:00:40,684 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39213,1676840440139, state=OPEN 2023-02-19 21:00:40,685 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 21:00:40,685 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 21:00:40,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 21:00:40,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39213,1676840440139 in 198 msec 2023-02-19 21:00:40,687 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 21:00:40,687 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-19 21:00:40,688 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 388 msec 2023-02-19 21:00:40,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676840440688, completionTime=-1 2023-02-19 21:00:40,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 21:00:40,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 21:00:40,694 DEBUG [hconnection-0x44566476-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:40,695 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52826, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:40,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 21:00:40,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676840500696 2023-02-19 21:00:40,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676840560696 2023-02-19 21:00:40,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-19 21:00:40,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38201,1676840440081-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38201,1676840440081-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38201,1676840440081-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38201, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:40,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 21:00:40,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:40,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 21:00:40,708 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 21:00:40,709 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 21:00:40,709 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 21:00:40,710 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:40,711 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728 empty. 2023-02-19 21:00:40,711 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:40,711 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 21:00:40,719 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:40,721 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 66a6e9b03d2e5cf115a5232a04da0728, NAME => 'hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp 2023-02-19 21:00:40,732 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:40,733 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 66a6e9b03d2e5cf115a5232a04da0728, disabling compactions & flushes 2023-02-19 21:00:40,733 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. 2023-02-19 21:00:40,733 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. 2023-02-19 21:00:40,733 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. after waiting 0 ms 2023-02-19 21:00:40,733 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. 2023-02-19 21:00:40,733 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. 2023-02-19 21:00:40,733 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 66a6e9b03d2e5cf115a5232a04da0728: 2023-02-19 21:00:40,734 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 21:00:40,735 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840440735"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840440735"}]},"ts":"1676840440735"} 2023-02-19 21:00:40,737 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 21:00:40,738 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 21:00:40,738 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840440738"}]},"ts":"1676840440738"} 2023-02-19 21:00:40,739 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 21:00:40,742 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:40,742 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:40,742 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:40,742 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:40,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=66a6e9b03d2e5cf115a5232a04da0728, ASSIGN}] 2023-02-19 21:00:40,745 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=66a6e9b03d2e5cf115a5232a04da0728, ASSIGN 2023-02-19 21:00:40,745 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=66a6e9b03d2e5cf115a5232a04da0728, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39213,1676840440139; forceNewPlan=false, retain=false 2023-02-19 21:00:40,896 INFO [jenkins-hbase4:38201] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 21:00:40,896 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=66a6e9b03d2e5cf115a5232a04da0728, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:40,896 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840440896"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840440896"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840440896"}]},"ts":"1676840440896"} 2023-02-19 21:00:40,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 66a6e9b03d2e5cf115a5232a04da0728, server=jenkins-hbase4.apache.org,39213,1676840440139}] 2023-02-19 21:00:41,052 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. 2023-02-19 21:00:41,053 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39213%2C1676840440139, suffix=, logDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/WALs/jenkins-hbase4.apache.org,39213,1676840440139, archiveDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/oldWALs, maxLogs=32 2023-02-19 21:00:41,066 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40557,DS-f3ee981c-be9c-49c7-8179-441d5e33aa63,DISK] 2023-02-19 21:00:41,066 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43793,DS-2beffe5d-0d8c-4231-b9bf-2fa662a5e00d,DISK] 2023-02-19 21:00:41,068 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/WALs/jenkins-hbase4.apache.org,39213,1676840440139/jenkins-hbase4.apache.org%2C39213%2C1676840440139.1676840441054 2023-02-19 21:00:41,068 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40557,DS-f3ee981c-be9c-49c7-8179-441d5e33aa63,DISK], DatanodeInfoWithStorage[127.0.0.1:43793,DS-2beffe5d-0d8c-4231-b9bf-2fa662a5e00d,DISK]] 2023-02-19 21:00:41,068 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 66a6e9b03d2e5cf115a5232a04da0728, NAME => 'hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:41,068 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:41,068 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:41,068 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:41,068 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:41,069 INFO [StoreOpener-66a6e9b03d2e5cf115a5232a04da0728-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:41,070 DEBUG [StoreOpener-66a6e9b03d2e5cf115a5232a04da0728-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728/info 2023-02-19 21:00:41,070 DEBUG [StoreOpener-66a6e9b03d2e5cf115a5232a04da0728-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728/info 2023-02-19 21:00:41,070 INFO [StoreOpener-66a6e9b03d2e5cf115a5232a04da0728-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66a6e9b03d2e5cf115a5232a04da0728 columnFamilyName info 2023-02-19 21:00:41,071 INFO [StoreOpener-66a6e9b03d2e5cf115a5232a04da0728-1] regionserver.HStore(310): Store=66a6e9b03d2e5cf115a5232a04da0728/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:41,071 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:41,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:41,073 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:41,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:41,075 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 66a6e9b03d2e5cf115a5232a04da0728; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68340226, jitterRate=0.018348723649978638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 21:00:41,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 66a6e9b03d2e5cf115a5232a04da0728: 2023-02-19 21:00:41,076 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728., pid=6, masterSystemTime=1676840441050 2023-02-19 21:00:41,077 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. 2023-02-19 21:00:41,077 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. 2023-02-19 21:00:41,077 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=66a6e9b03d2e5cf115a5232a04da0728, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:41,078 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840441077"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840441077"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840441077"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840441077"}]},"ts":"1676840441077"} 2023-02-19 21:00:41,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 21:00:41,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 66a6e9b03d2e5cf115a5232a04da0728, server=jenkins-hbase4.apache.org,39213,1676840440139 in 181 msec 2023-02-19 21:00:41,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 21:00:41,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=66a6e9b03d2e5cf115a5232a04da0728, ASSIGN in 338 msec 2023-02-19 21:00:41,082 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 21:00:41,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840441082"}]},"ts":"1676840441082"} 2023-02-19 21:00:41,083 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 21:00:41,086 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 21:00:41,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 379 msec 2023-02-19 21:00:41,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 21:00:41,109 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:41,109 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:41,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 21:00:41,118 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:41,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 7 msec 2023-02-19 21:00:41,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 21:00:41,129 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:41,131 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-19 21:00:41,138 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 21:00:41,140 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 21:00:41,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.947sec 2023-02-19 21:00:41,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 21:00:41,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 21:00:41,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 21:00:41,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38201,1676840440081-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 21:00:41,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38201,1676840440081-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 21:00:41,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 21:00:41,190 DEBUG [Listener at localhost/41083] zookeeper.ReadOnlyZKClient(139): Connect 0x793caa2e to 127.0.0.1:59090 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:41,197 DEBUG [Listener at localhost/41083] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fbab1c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:41,198 DEBUG [hconnection-0x3b59e103-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:41,200 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52830, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:41,201 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38201,1676840440081 2023-02-19 21:00:41,201 DEBUG [Listener at localhost/41083] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 21:00:41,203 DEBUG [Listener at localhost/41083] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 21:00:41,205 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42170, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 21:00:41,205 INFO [Listener at localhost/41083] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:41,205 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:41,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 21:00:41,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:42170 deadline: 1676840501205, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:41,206 INFO [Listener at localhost/41083] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-19 21:00:41,208 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:41,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:41,210 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 21:00:41,210 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-19 21:00:41,210 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 21:00:41,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:41,212 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:41,212 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d empty. 2023-02-19 21:00:41,212 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:41,212 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-19 21:00:41,222 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:41,223 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 72e3108a7e2f66a8172d8c00902f098d, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp 2023-02-19 21:00:41,229 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:41,230 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 72e3108a7e2f66a8172d8c00902f098d, disabling compactions & flushes 2023-02-19 21:00:41,230 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:41,230 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:41,230 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. after waiting 0 ms 2023-02-19 21:00:41,230 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:41,230 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:41,230 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 72e3108a7e2f66a8172d8c00902f098d: 2023-02-19 21:00:41,231 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 21:00:41,232 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676840441232"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840441232"}]},"ts":"1676840441232"} 2023-02-19 21:00:41,233 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 21:00:41,234 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 21:00:41,234 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840441234"}]},"ts":"1676840441234"} 2023-02-19 21:00:41,235 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-19 21:00:41,237 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:41,238 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:41,238 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:41,238 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:41,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=72e3108a7e2f66a8172d8c00902f098d, ASSIGN}] 2023-02-19 21:00:41,239 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=72e3108a7e2f66a8172d8c00902f098d, ASSIGN 2023-02-19 21:00:41,240 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=72e3108a7e2f66a8172d8c00902f098d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39213,1676840440139; forceNewPlan=false, retain=false 2023-02-19 21:00:41,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:41,390 INFO [jenkins-hbase4:38201] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 21:00:41,390 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=72e3108a7e2f66a8172d8c00902f098d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:41,391 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676840441390"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840441390"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840441390"}]},"ts":"1676840441390"} 2023-02-19 21:00:41,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 72e3108a7e2f66a8172d8c00902f098d, server=jenkins-hbase4.apache.org,39213,1676840440139}] 2023-02-19 21:00:41,461 INFO [RS:1;jenkins-hbase4:43911] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43911%2C1676840440175, suffix=, logDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/WALs/jenkins-hbase4.apache.org,43911,1676840440175, archiveDir=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/oldWALs, maxLogs=32 2023-02-19 21:00:41,478 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43793,DS-2beffe5d-0d8c-4231-b9bf-2fa662a5e00d,DISK] 2023-02-19 21:00:41,478 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40557,DS-f3ee981c-be9c-49c7-8179-441d5e33aa63,DISK] 2023-02-19 21:00:41,484 INFO [RS:1;jenkins-hbase4:43911] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/WALs/jenkins-hbase4.apache.org,43911,1676840440175/jenkins-hbase4.apache.org%2C43911%2C1676840440175.1676840441461 2023-02-19 21:00:41,484 DEBUG [RS:1;jenkins-hbase4:43911] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43793,DS-2beffe5d-0d8c-4231-b9bf-2fa662a5e00d,DISK], DatanodeInfoWithStorage[127.0.0.1:40557,DS-f3ee981c-be9c-49c7-8179-441d5e33aa63,DISK]] 2023-02-19 21:00:41,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:41,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:41,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 72e3108a7e2f66a8172d8c00902f098d, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:41,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:41,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:41,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:41,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:41,548 INFO [StoreOpener-72e3108a7e2f66a8172d8c00902f098d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:41,549 DEBUG [StoreOpener-72e3108a7e2f66a8172d8c00902f098d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1 2023-02-19 21:00:41,549 DEBUG [StoreOpener-72e3108a7e2f66a8172d8c00902f098d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1 2023-02-19 21:00:41,549 INFO [StoreOpener-72e3108a7e2f66a8172d8c00902f098d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72e3108a7e2f66a8172d8c00902f098d columnFamilyName f1 2023-02-19 21:00:41,549 INFO [StoreOpener-72e3108a7e2f66a8172d8c00902f098d-1] regionserver.HStore(310): Store=72e3108a7e2f66a8172d8c00902f098d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:41,549 INFO [StoreOpener-72e3108a7e2f66a8172d8c00902f098d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:41,550 DEBUG [StoreOpener-72e3108a7e2f66a8172d8c00902f098d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2 2023-02-19 21:00:41,550 DEBUG [StoreOpener-72e3108a7e2f66a8172d8c00902f098d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2 2023-02-19 21:00:41,551 INFO [StoreOpener-72e3108a7e2f66a8172d8c00902f098d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72e3108a7e2f66a8172d8c00902f098d columnFamilyName f2 2023-02-19 21:00:41,551 INFO [StoreOpener-72e3108a7e2f66a8172d8c00902f098d-1] regionserver.HStore(310): Store=72e3108a7e2f66a8172d8c00902f098d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:41,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:41,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:41,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:41,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:41,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:41,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 72e3108a7e2f66a8172d8c00902f098d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65122689, jitterRate=-0.02959631383419037}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:41,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 72e3108a7e2f66a8172d8c00902f098d: 2023-02-19 21:00:41,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d., pid=12, masterSystemTime=1676840441544 2023-02-19 21:00:41,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:41,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:41,558 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=72e3108a7e2f66a8172d8c00902f098d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:41,558 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676840441558"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840441558"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840441558"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840441558"}]},"ts":"1676840441558"} 2023-02-19 21:00:41,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-19 21:00:41,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 72e3108a7e2f66a8172d8c00902f098d, server=jenkins-hbase4.apache.org,39213,1676840440139 in 167 msec 2023-02-19 21:00:41,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-19 21:00:41,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=72e3108a7e2f66a8172d8c00902f098d, ASSIGN in 322 msec 2023-02-19 21:00:41,562 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 21:00:41,562 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840441562"}]},"ts":"1676840441562"} 2023-02-19 21:00:41,563 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-19 21:00:41,565 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 21:00:41,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 357 msec 2023-02-19 21:00:41,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:41,815 INFO [Listener at localhost/41083] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-19 21:00:41,815 DEBUG [Listener at localhost/41083] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-19 21:00:41,815 INFO [Listener at localhost/41083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 21:00:41,817 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-19 21:00:41,817 INFO [Listener at localhost/41083] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 21:00:41,817 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-19 21:00:41,817 INFO [Listener at localhost/41083] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 21:00:41,848 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39213] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:41,941 INFO [Listener at localhost/41083] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 21:00:41,941 INFO [Listener at localhost/41083] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 21:00:41,942 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-19 21:00:41,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676840441942 (current time:1676840441942). 2023-02-19 21:00:41,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 21:00:41,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] zookeeper.ReadOnlyZKClient(139): Connect 0x17038b25 to 127.0.0.1:59090 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:41,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d9fb881, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:41,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:41,948 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52834, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:41,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17038b25 to 127.0.0.1:59090 2023-02-19 21:00:41,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:41,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 21:00:41,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-19 21:00:41,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-19 21:00:41,952 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-19 21:00:41,952 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676841041952 2023-02-19 21:00:41,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-19 21:00:41,953 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:41,954 DEBUG [Listener at localhost/41083] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:41,954 DEBUG [Listener at localhost/41083] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 21:00:41,955 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-19 21:00:41,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-19 21:00:41,956 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-19 21:00:41,957 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-19 21:00:41,957 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676841041957 2023-02-19 21:00:41,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-19 21:00:41,968 INFO [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-19 21:00:41,968 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:41,968 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-19 21:00:41,968 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-19 21:00:41,969 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 21:00:41,969 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-19 21:00:41,971 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:41,971 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:41,971 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:41,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:41,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:41,971 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:41,971 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-19 21:00:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-19 21:00:41,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 21:00:41,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 21:00:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-19 21:00:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-19 21:00:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-19 21:00:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-19 21:00:41,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-19 21:00:41,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-19 21:00:41,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-19 21:00:41,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-19 21:00:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-19 21:00:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-19 21:00:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-19 21:00:41,974 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-19 21:00:41,974 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-19 21:00:41,974 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-19 21:00:41,974 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43911,1676840440175' joining acquired barrier for procedure (foo) in zk 2023-02-19 21:00:41,974 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39213,1676840440139' joining acquired barrier for procedure (foo) in zk 2023-02-19 21:00:41,975 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:41,975 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:41,975 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:41,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:41,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:41,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:41,976 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-19 21:00:41,976 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:41,976 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-19 21:00:41,976 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:41,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:41,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:41,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 21:00:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:41,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39213,1676840440139' joining acquired barrier for procedure 'foo' on coordinator 2023-02-19 21:00:41,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6722f5f0[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:41,977 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-19 21:00:41,977 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:41,978 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 21:00:41,978 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 21:00:41,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:41,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:41,978 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-19 21:00:41,978 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:41,978 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:41,978 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-19 21:00:41,978 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,43911,1676840440175' in zk 2023-02-19 21:00:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-19 21:00:41,979 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-19 21:00:41,979 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-19 21:00:41,979 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 21:00:41,979 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:41,979 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. started... 2023-02-19 21:00:41,979 INFO [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 72e3108a7e2f66a8172d8c00902f098d 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-19 21:00:41,980 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-19 21:00:41,980 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:41,980 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-19 21:00:41,997 INFO [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/.tmp/f1/91f0661a281b483391c6a5acb01e1cdb 2023-02-19 21:00:42,020 INFO [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/.tmp/f2/08cb4c1e74304b39b5031f2003815ca5 2023-02-19 21:00:42,025 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/.tmp/f1/91f0661a281b483391c6a5acb01e1cdb as hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1/91f0661a281b483391c6a5acb01e1cdb 2023-02-19 21:00:42,028 INFO [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1/91f0661a281b483391c6a5acb01e1cdb, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 21:00:42,029 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/.tmp/f2/08cb4c1e74304b39b5031f2003815ca5 as hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2/08cb4c1e74304b39b5031f2003815ca5 2023-02-19 21:00:42,032 INFO [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2/08cb4c1e74304b39b5031f2003815ca5, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 21:00:42,033 INFO [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 72e3108a7e2f66a8172d8c00902f098d in 54ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:42,033 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-19 21:00:42,034 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 72e3108a7e2f66a8172d8c00902f098d: 2023-02-19 21:00:42,034 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.' region-info for snapshot=foo 2023-02-19 21:00:42,034 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:42,034 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1/91f0661a281b483391c6a5acb01e1cdb] hfiles 2023-02-19 21:00:42,034 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1/91f0661a281b483391c6a5acb01e1cdb for snapshot=foo 2023-02-19 21:00:42,034 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2/08cb4c1e74304b39b5031f2003815ca5] hfiles 2023-02-19 21:00:42,034 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2/08cb4c1e74304b39b5031f2003815ca5 for snapshot=foo 2023-02-19 21:00:42,039 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. completed. 2023-02-19 21:00:42,039 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:42,039 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-19 21:00:42,039 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-19 21:00:42,039 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,039 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-19 21:00:42,039 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,39213,1676840440139' in zk 2023-02-19 21:00:42,041 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,041 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-19 21:00:42,041 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:42,041 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-19 21:00:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 21:00:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 21:00:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,39213,1676840440139': 2023-02-19 21:00:42,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39213,1676840440139' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-19 21:00:42,044 INFO [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-19 21:00:42,044 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:42,044 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:42,044 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-19 21:00:42,044 INFO [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 21:00:42,046 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 21:00:42,046 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 21:00:42,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-19 21:00:42,046 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:42,046 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 21:00:42,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 21:00:42,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-19 21:00:42,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:42,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:42,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-19 21:00:42,046 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:42,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 21:00:42,046 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:42,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:42,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:42,047 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 21:00:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 21:00:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 21:00:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 21:00:42,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,048 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,048 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:42,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 21:00:42,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,054 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,054 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-19 21:00:42,054 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:42,055 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,054 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:42,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-19 21:00:42,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/foo because node does not exist (not an error) 2023-02-19 21:00:42,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-19 21:00:42,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:42,055 DEBUG [Listener at localhost/41083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:42,055 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:42,055 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-19 21:00:42,055 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:42,055 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:42,055 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:42,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:42,055 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 21:00:42,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:42,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.hbase-snapshot/.tmp/foo 2023-02-19 21:00:42,055 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,055 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 21:00:42,055 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 21:00:42,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:42,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:42,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:42,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:42,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-19 21:00:42,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-19 21:00:42,056 DEBUG [Listener at localhost/41083] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 21:00:42,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.hbase-snapshot/.tmp/foo to hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.hbase-snapshot/foo 2023-02-19 21:00:42,094 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-19 21:00:42,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.hbase-snapshot/.tmp/foo 2023-02-19 21:00:42,094 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.hbase-snapshot/.tmp/foo 2023-02-19 21:00:42,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676840441953Consolidate snapshot: foo at 1676840442055 (+102 ms)Loading Region manifests for foo at 1676840442055Writing data manifest for foo at 1676840442057 (+2 ms)Verifying snapshot: foo at 1676840442069 (+12 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676840442094 (+25 ms) 2023-02-19 21:00:42,099 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-19 21:00:42,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 145 msec 2023-02-19 21:00:42,256 DEBUG [Listener at localhost/41083] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:42,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-19 21:00:42,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 21:00:42,258 INFO [Listener at localhost/41083] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 21:00:42,261 INFO [Listener at localhost/41083] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 21:00:42,266 INFO [Listener at localhost/41083] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 21:00:42,295 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39213] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:42,445 INFO [Listener at localhost/41083] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 21:00:42,450 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 21:00:42,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,452 INFO [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-19 21:00:42,452 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:42,453 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-19 21:00:42,453 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-19 21:00:42,453 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,453 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,454 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:42,454 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:42,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:42,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:42,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:42,454 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,455 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,455 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:42,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,455 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,456 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,456 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-19 21:00:42,456 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:42,456 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-19 21:00:42,457 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-19 21:00:42,457 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-19 21:00:42,457 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:42,457 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43911,1676840440175' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-19 21:00:42,457 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-19 21:00:42,458 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-19 21:00:42,458 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 21:00:42,458 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:42,458 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. started... 2023-02-19 21:00:42,458 INFO [rs(jenkins-hbase4.apache.org,39213,1676840440139)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 72e3108a7e2f66a8172d8c00902f098d 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-19 21:00:42,459 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,459 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,459 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:42,471 INFO [rs(jenkins-hbase4.apache.org,39213,1676840440139)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/.tmp/f1/33b5604bb0a543a084a4a5f156298417 2023-02-19 21:00:42,487 INFO [rs(jenkins-hbase4.apache.org,39213,1676840440139)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/.tmp/f2/315da740989f4ed19433d162af91b55c 2023-02-19 21:00:42,491 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/.tmp/f1/33b5604bb0a543a084a4a5f156298417 as hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1/33b5604bb0a543a084a4a5f156298417 2023-02-19 21:00:42,495 INFO [rs(jenkins-hbase4.apache.org,39213,1676840440139)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1/33b5604bb0a543a084a4a5f156298417, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 21:00:42,495 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/.tmp/f2/315da740989f4ed19433d162af91b55c as hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2/315da740989f4ed19433d162af91b55c 2023-02-19 21:00:42,499 INFO [rs(jenkins-hbase4.apache.org,39213,1676840440139)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2/315da740989f4ed19433d162af91b55c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 21:00:42,500 INFO [rs(jenkins-hbase4.apache.org,39213,1676840440139)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 72e3108a7e2f66a8172d8c00902f098d in 42ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:42,501 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 72e3108a7e2f66a8172d8c00902f098d: 2023-02-19 21:00:42,501 DEBUG [rs(jenkins-hbase4.apache.org,39213,1676840440139)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:42,501 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-19 21:00:42,501 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-19 21:00:42,501 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,501 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-19 21:00:42,501 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39213,1676840440139' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-19 21:00:42,502 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,502 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:42,503 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,503 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:42,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39213,1676840440139' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-19 21:00:42,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@631d6dcc[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:42,505 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-19 21:00:42,505 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,507 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,507 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,507 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-19 21:00:42,507 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,507 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:42,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,507 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-19 21:00:42,507 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,43911,1676840440175' in zk 2023-02-19 21:00:42,507 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-19 21:00:42,507 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-19 21:00:42,507 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,39213,1676840440139' in zk 2023-02-19 21:00:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-19 21:00:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,43911,1676840440175' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-19 21:00:42,509 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:42,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:42,509 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-19 21:00:42,509 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:42,509 DEBUG [member: 'jenkins-hbase4.apache.org,39213,1676840440139' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-19 21:00:42,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:42,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:42,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:42,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,39213,1676840440139': 2023-02-19 21:00:42,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39213,1676840440139' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-19 21:00:42,512 INFO [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-19 21:00:42,512 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:42,512 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:42,512 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,512 INFO [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 21:00:42,513 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,513 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:42,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:42,513 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:42,513 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,514 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,514 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:42,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:42,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,514 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:42,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,515 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,516 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:42,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,519 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,519 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,519 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:42,519 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:42,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:42,519 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:42,520 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-19 21:00:42,520 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 21:00:42,520 DEBUG [(jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:42,520 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,520 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:42,520 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:42,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:42,520 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:42,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:42,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:42,520 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,520 DEBUG [Listener at localhost/41083] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:42,520 DEBUG [Listener at localhost/41083] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 21:00:42,520 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:42,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:42,520 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,521 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,620 DEBUG [Listener at localhost/41083] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 21:00:42,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 21:00:42,627 INFO [Listener at localhost/41083] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676840441942 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:42,627 DEBUG [Listener at localhost/41083] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34591/user/jenkins/test-data/f23c8640-207f-9af8-f57b-34457d478fad/foo/8b3f927b-b790-4168-b3ab-7cf59ce3130c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,628 INFO [Listener at localhost/41083] snapshot.RestoreSnapshotHelper(239): region to add: 72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:42,628 INFO [Listener at localhost/41083] snapshot.RestoreSnapshotHelper(585): clone region=72e3108a7e2f66a8172d8c00902f098d as 72e3108a7e2f66a8172d8c00902f098d in snapshot foo 2023-02-19 21:00:42,629 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 72e3108a7e2f66a8172d8c00902f098d, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34591/user/jenkins/test-data/f23c8640-207f-9af8-f57b-34457d478fad/foo/8b3f927b-b790-4168-b3ab-7cf59ce3130c 2023-02-19 21:00:42,642 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:42,642 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 91f0661a281b483391c6a5acb01e1cdb from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,645 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 08cb4c1e74304b39b5031f2003815ca5 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,647 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 72e3108a7e2f66a8172d8c00902f098d, disabling compactions & flushes 2023-02-19 21:00:42,648 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:42,648 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:42,648 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. after waiting 0 ms 2023-02-19 21:00:42,648 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:42,648 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:42,648 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 72e3108a7e2f66a8172d8c00902f098d: 2023-02-19 21:00:42,650 INFO [Listener at localhost/41083] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676840441942 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:42,650 DEBUG [Listener at localhost/41083] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34591/user/jenkins/test-data/f23c8640-207f-9af8-f57b-34457d478fad/foo/8b3f927b-b790-4168-b3ab-7cf59ce3130c 2023-02-19 21:00:42,650 DEBUG [Listener at localhost/41083] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34591/user/jenkins/test-data/f23c8640-207f-9af8-f57b-34457d478fad/foo/8b3f927b-b790-4168-b3ab-7cf59ce3130c 2023-02-19 21:00:42,650 DEBUG [Listener at localhost/41083] util.CommonFSUtils(699): |-data/ 2023-02-19 21:00:42,651 DEBUG [Listener at localhost/41083] util.CommonFSUtils(699): |----default/ 2023-02-19 21:00:42,651 DEBUG [Listener at localhost/41083] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-19 21:00:42,651 DEBUG [Listener at localhost/41083] util.CommonFSUtils(699): |----------72e3108a7e2f66a8172d8c00902f098d/ 2023-02-19 21:00:42,651 DEBUG [Listener at localhost/41083] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:42,652 DEBUG [Listener at localhost/41083] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:42,652 DEBUG [Listener at localhost/41083] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=72e3108a7e2f66a8172d8c00902f098d-91f0661a281b483391c6a5acb01e1cdb 2023-02-19 21:00:42,652 DEBUG [Listener at localhost/41083] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:42,652 DEBUG [Listener at localhost/41083] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=72e3108a7e2f66a8172d8c00902f098d-08cb4c1e74304b39b5031f2003815ca5 hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1/33b5604bb0a543a084a4a5f156298417 hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1/91f0661a281b483391c6a5acb01e1cdb hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2/08cb4c1e74304b39b5031f2003815ca5 hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2/315da740989f4ed19433d162af91b55c 2023-02-19 21:00:42,661 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-19 21:00:42,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-19 21:00:42,665 INFO [Listener at localhost/41083] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,666 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 21:00:42,669 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840442669"}]},"ts":"1676840442669"} 2023-02-19 21:00:42,670 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-19 21:00:42,671 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-19 21:00:42,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=72e3108a7e2f66a8172d8c00902f098d, UNASSIGN}] 2023-02-19 21:00:42,672 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=72e3108a7e2f66a8172d8c00902f098d, UNASSIGN 2023-02-19 21:00:42,673 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=72e3108a7e2f66a8172d8c00902f098d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:42,673 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676840442673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840442673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840442673"}]},"ts":"1676840442673"} 2023-02-19 21:00:42,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 72e3108a7e2f66a8172d8c00902f098d, server=jenkins-hbase4.apache.org,39213,1676840440139}] 2023-02-19 21:00:42,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 21:00:42,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:42,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 72e3108a7e2f66a8172d8c00902f098d, disabling compactions & flushes 2023-02-19 21:00:42,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:42,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:42,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. after waiting 0 ms 2023-02-19 21:00:42,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:42,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:42,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d. 2023-02-19 21:00:42,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 72e3108a7e2f66a8172d8c00902f098d: 2023-02-19 21:00:42,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:42,832 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=72e3108a7e2f66a8172d8c00902f098d, regionState=CLOSED 2023-02-19 21:00:42,832 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676840442832"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840442832"}]},"ts":"1676840442832"} 2023-02-19 21:00:42,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-19 21:00:42,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 72e3108a7e2f66a8172d8c00902f098d, server=jenkins-hbase4.apache.org,39213,1676840440139 in 159 msec 2023-02-19 21:00:42,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-19 21:00:42,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=72e3108a7e2f66a8172d8c00902f098d, UNASSIGN in 163 msec 2023-02-19 21:00:42,837 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840442837"}]},"ts":"1676840442837"} 2023-02-19 21:00:42,838 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-19 21:00:42,839 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-19 21:00:42,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 174 msec 2023-02-19 21:00:42,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 21:00:42,972 INFO [Listener at localhost/41083] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-19 21:00:42,972 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,975 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,975 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 21:00:42,978 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:42,980 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1, FileablePath, hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2, FileablePath, hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/recovered.edits] 2023-02-19 21:00:42,983 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1/33b5604bb0a543a084a4a5f156298417 to hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1/33b5604bb0a543a084a4a5f156298417 2023-02-19 21:00:42,984 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1/91f0661a281b483391c6a5acb01e1cdb to hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f1/91f0661a281b483391c6a5acb01e1cdb 2023-02-19 21:00:42,987 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2/08cb4c1e74304b39b5031f2003815ca5 to hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2/08cb4c1e74304b39b5031f2003815ca5 2023-02-19 21:00:42,988 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2/315da740989f4ed19433d162af91b55c to hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/f2/315da740989f4ed19433d162af91b55c 2023-02-19 21:00:42,990 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/recovered.edits/12.seqid to hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d/recovered.edits/12.seqid 2023-02-19 21:00:42,991 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/72e3108a7e2f66a8172d8c00902f098d 2023-02-19 21:00:42,991 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-19 21:00:42,992 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,994 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-19 21:00:42,998 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-19 21:00:42,999 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:42,999 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-19 21:00:42,999 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840442999"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:43,000 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-19 21:00:43,000 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 72e3108a7e2f66a8172d8c00902f098d, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676840441208.72e3108a7e2f66a8172d8c00902f098d.', STARTKEY => '', ENDKEY => ''}] 2023-02-19 21:00:43,000 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-19 21:00:43,001 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676840443000"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:43,001 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-19 21:00:43,003 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 21:00:43,004 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 30 msec 2023-02-19 21:00:43,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38201] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 21:00:43,077 INFO [Listener at localhost/41083] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-19 21:00:43,077 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 21:00:43,077 INFO [Listener at localhost/41083] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 21:00:43,078 DEBUG [Listener at localhost/41083] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x793caa2e to 127.0.0.1:59090 2023-02-19 21:00:43,078 DEBUG [Listener at localhost/41083] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:43,078 DEBUG [Listener at localhost/41083] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 21:00:43,078 DEBUG [Listener at localhost/41083] util.JVMClusterUtil(257): Found active master hash=1627180613, stopped=false 2023-02-19 21:00:43,078 INFO [Listener at localhost/41083] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38201,1676840440081 2023-02-19 21:00:43,079 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:43,079 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:43,079 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:43,079 INFO [Listener at localhost/41083] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 21:00:43,079 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:43,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:43,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:43,080 DEBUG [Listener at localhost/41083] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7940d220 to 127.0.0.1:59090 2023-02-19 21:00:43,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:43,081 DEBUG [Listener at localhost/41083] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:43,081 INFO [Listener at localhost/41083] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39213,1676840440139' ***** 2023-02-19 21:00:43,081 INFO [Listener at localhost/41083] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:43,081 INFO [Listener at localhost/41083] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43911,1676840440175' ***** 2023-02-19 21:00:43,081 INFO [Listener at localhost/41083] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:43,081 INFO [RS:0;jenkins-hbase4:39213] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:43,082 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:43,082 INFO [RS:0;jenkins-hbase4:39213] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:43,082 INFO [RS:1;jenkins-hbase4:43911] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:43,082 INFO [RS:0;jenkins-hbase4:39213] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:43,082 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:43,083 INFO [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(3304): Received CLOSE for 66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:43,082 INFO [RS:1;jenkins-hbase4:43911] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:43,083 INFO [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:43,083 INFO [RS:1;jenkins-hbase4:43911] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:43,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 66a6e9b03d2e5cf115a5232a04da0728, disabling compactions & flushes 2023-02-19 21:00:43,083 INFO [RS:1;jenkins-hbase4:43911] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:43,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. 2023-02-19 21:00:43,083 DEBUG [RS:1;jenkins-hbase4:43911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c5d6585 to 127.0.0.1:59090 2023-02-19 21:00:43,083 DEBUG [RS:0;jenkins-hbase4:39213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54594bb9 to 127.0.0.1:59090 2023-02-19 21:00:43,083 DEBUG [RS:1;jenkins-hbase4:43911] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:43,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. 2023-02-19 21:00:43,084 INFO [RS:1;jenkins-hbase4:43911] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43911,1676840440175; all regions closed. 2023-02-19 21:00:43,084 DEBUG [RS:0;jenkins-hbase4:39213] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:43,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. after waiting 0 ms 2023-02-19 21:00:43,084 INFO [RS:0;jenkins-hbase4:39213] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:43,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. 2023-02-19 21:00:43,084 INFO [RS:0;jenkins-hbase4:39213] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:43,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 66a6e9b03d2e5cf115a5232a04da0728 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 21:00:43,084 INFO [RS:0;jenkins-hbase4:39213] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:43,084 INFO [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 21:00:43,084 INFO [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-19 21:00:43,084 DEBUG [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1479): Online Regions={66a6e9b03d2e5cf115a5232a04da0728=hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728., 1588230740=hbase:meta,,1.1588230740} 2023-02-19 21:00:43,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:43,084 DEBUG [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1505): Waiting on 1588230740, 66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:43,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:43,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:43,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:43,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:43,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-19 21:00:43,088 DEBUG [RS:1;jenkins-hbase4:43911] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/oldWALs 2023-02-19 21:00:43,088 INFO [RS:1;jenkins-hbase4:43911] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43911%2C1676840440175:(num 1676840441461) 2023-02-19 21:00:43,088 DEBUG [RS:1;jenkins-hbase4:43911] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:43,088 INFO [RS:1;jenkins-hbase4:43911] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:43,088 INFO [RS:1;jenkins-hbase4:43911] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:43,088 INFO [RS:1;jenkins-hbase4:43911] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:43,088 INFO [RS:1;jenkins-hbase4:43911] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:43,088 INFO [RS:1;jenkins-hbase4:43911] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:43,088 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:43,089 INFO [RS:1;jenkins-hbase4:43911] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43911 2023-02-19 21:00:43,091 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:43,091 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:43,091 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43911,1676840440175 2023-02-19 21:00:43,091 ERROR [Listener at localhost/41083-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5bee5e56 rejected from java.util.concurrent.ThreadPoolExecutor@5fd1d1f3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:43,091 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:43,091 ERROR [Listener at localhost/41083-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2b60816 rejected from java.util.concurrent.ThreadPoolExecutor@5fd1d1f3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:43,092 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:43,100 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43911,1676840440175] 2023-02-19 21:00:43,100 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43911,1676840440175; numProcessing=1 2023-02-19 21:00:43,102 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43911,1676840440175 already deleted, retry=false 2023-02-19 21:00:43,102 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43911,1676840440175 expired; onlineServers=1 2023-02-19 21:00:43,116 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/.tmp/info/0ee82f9d5c3d46469b6f9f7fc36eb1fd 2023-02-19 21:00:43,123 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ee82f9d5c3d46469b6f9f7fc36eb1fd 2023-02-19 21:00:43,137 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/.tmp/rep_barrier/942b855855474bb08fb7730ecf987f87 2023-02-19 21:00:43,141 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 942b855855474bb08fb7730ecf987f87 2023-02-19 21:00:43,147 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/.tmp/table/43130cc9b56445be8a87690805d1e917 2023-02-19 21:00:43,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43130cc9b56445be8a87690805d1e917 2023-02-19 21:00:43,151 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/.tmp/info/0ee82f9d5c3d46469b6f9f7fc36eb1fd as hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/info/0ee82f9d5c3d46469b6f9f7fc36eb1fd 2023-02-19 21:00:43,155 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ee82f9d5c3d46469b6f9f7fc36eb1fd 2023-02-19 21:00:43,155 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/info/0ee82f9d5c3d46469b6f9f7fc36eb1fd, entries=12, sequenceid=21, filesize=6.3 K 2023-02-19 21:00:43,156 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/.tmp/rep_barrier/942b855855474bb08fb7730ecf987f87 as hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/rep_barrier/942b855855474bb08fb7730ecf987f87 2023-02-19 21:00:43,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 942b855855474bb08fb7730ecf987f87 2023-02-19 21:00:43,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/rep_barrier/942b855855474bb08fb7730ecf987f87, entries=1, sequenceid=21, filesize=5.1 K 2023-02-19 21:00:43,161 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/.tmp/table/43130cc9b56445be8a87690805d1e917 as hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/table/43130cc9b56445be8a87690805d1e917 2023-02-19 21:00:43,165 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43130cc9b56445be8a87690805d1e917 2023-02-19 21:00:43,165 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/table/43130cc9b56445be8a87690805d1e917, entries=4, sequenceid=21, filesize=5.1 K 2023-02-19 21:00:43,165 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:43,165 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:43,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 84ms, sequenceid=21, compaction requested=false 2023-02-19 21:00:43,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-19 21:00:43,174 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-19 21:00:43,175 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 21:00:43,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:43,175 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:43,175 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:43,279 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:43,279 INFO [RS:1;jenkins-hbase4:43911] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43911,1676840440175; zookeeper connection closed. 2023-02-19 21:00:43,279 ERROR [Listener at localhost/41083-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a0ce832 rejected from java.util.concurrent.ThreadPoolExecutor@5fd1d1f3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:43,280 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:43911-0x1006e627abf0002, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:43,280 ERROR [Listener at localhost/41083-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4838fad3 rejected from java.util.concurrent.ThreadPoolExecutor@5fd1d1f3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:43,280 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5bb9d4e4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5bb9d4e4 2023-02-19 21:00:43,284 DEBUG [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1505): Waiting on 66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:43,430 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 21:00:43,431 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 21:00:43,485 DEBUG [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1505): Waiting on 66a6e9b03d2e5cf115a5232a04da0728 2023-02-19 21:00:43,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728/.tmp/info/6ea9236a80664ee58759a45dbdb17a8e 2023-02-19 21:00:43,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728/.tmp/info/6ea9236a80664ee58759a45dbdb17a8e as hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728/info/6ea9236a80664ee58759a45dbdb17a8e 2023-02-19 21:00:43,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728/info/6ea9236a80664ee58759a45dbdb17a8e, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 21:00:43,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 66a6e9b03d2e5cf115a5232a04da0728 in 449ms, sequenceid=6, compaction requested=false 2023-02-19 21:00:43,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-19 21:00:43,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/data/hbase/namespace/66a6e9b03d2e5cf115a5232a04da0728/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 21:00:43,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. 2023-02-19 21:00:43,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 66a6e9b03d2e5cf115a5232a04da0728: 2023-02-19 21:00:43,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676840440707.66a6e9b03d2e5cf115a5232a04da0728. 2023-02-19 21:00:43,617 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 21:00:43,685 INFO [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39213,1676840440139; all regions closed. 2023-02-19 21:00:43,694 DEBUG [RS:0;jenkins-hbase4:39213] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/oldWALs 2023-02-19 21:00:43,694 INFO [RS:0;jenkins-hbase4:39213] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39213%2C1676840440139.meta:.meta(num 1676840440649) 2023-02-19 21:00:43,703 DEBUG [RS:0;jenkins-hbase4:39213] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/oldWALs 2023-02-19 21:00:43,703 INFO [RS:0;jenkins-hbase4:39213] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39213%2C1676840440139:(num 1676840441054) 2023-02-19 21:00:43,703 DEBUG [RS:0;jenkins-hbase4:39213] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:43,703 INFO [RS:0;jenkins-hbase4:39213] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:43,703 INFO [RS:0;jenkins-hbase4:39213] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:43,703 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:43,705 INFO [RS:0;jenkins-hbase4:39213] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39213 2023-02-19 21:00:43,708 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39213,1676840440139 2023-02-19 21:00:43,708 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:43,708 ERROR [Listener at localhost/41083-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@186bc121 rejected from java.util.concurrent.ThreadPoolExecutor@1c5446f4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:43,709 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39213,1676840440139] 2023-02-19 21:00:43,709 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39213,1676840440139; numProcessing=2 2023-02-19 21:00:43,710 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39213,1676840440139 already deleted, retry=false 2023-02-19 21:00:43,711 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39213,1676840440139 expired; onlineServers=0 2023-02-19 21:00:43,711 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38201,1676840440081' ***** 2023-02-19 21:00:43,711 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 21:00:43,711 DEBUG [M:0;jenkins-hbase4:38201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64c35682, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:43,712 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38201,1676840440081 2023-02-19 21:00:43,712 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38201,1676840440081; all regions closed. 2023-02-19 21:00:43,712 DEBUG [M:0;jenkins-hbase4:38201] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:43,712 DEBUG [M:0;jenkins-hbase4:38201] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 21:00:43,712 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 21:00:43,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840440306] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840440306,5,FailOnTimeoutGroup] 2023-02-19 21:00:43,712 DEBUG [M:0;jenkins-hbase4:38201] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 21:00:43,713 INFO [M:0;jenkins-hbase4:38201] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 21:00:43,713 INFO [M:0;jenkins-hbase4:38201] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 21:00:43,713 INFO [M:0;jenkins-hbase4:38201] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 21:00:43,713 DEBUG [M:0;jenkins-hbase4:38201] master.HMaster(1512): Stopping service threads 2023-02-19 21:00:43,713 INFO [M:0;jenkins-hbase4:38201] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 21:00:43,713 ERROR [M:0;jenkins-hbase4:38201] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 21:00:43,713 INFO [M:0;jenkins-hbase4:38201] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 21:00:43,713 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 21:00:43,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840440306] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840440306,5,FailOnTimeoutGroup] 2023-02-19 21:00:43,810 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:43,810 INFO [RS:0;jenkins-hbase4:39213] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39213,1676840440139; zookeeper connection closed. 2023-02-19 21:00:43,810 ERROR [Listener at localhost/41083-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e610db9 rejected from java.util.concurrent.ThreadPoolExecutor@1c5446f4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:43,810 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): regionserver:39213-0x1006e627abf0001, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:43,810 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@244bd133] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@244bd133 2023-02-19 21:00:43,810 ERROR [Listener at localhost/41083-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56982b87 rejected from java.util.concurrent.ThreadPoolExecutor@1c5446f4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:43,810 INFO [Listener at localhost/41083] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 21:00:43,811 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:43,811 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:43,811 INFO [M:0;jenkins-hbase4:38201] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 21:00:43,812 INFO [M:0;jenkins-hbase4:38201] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 21:00:43,813 DEBUG [M:0;jenkins-hbase4:38201] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:43,813 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:43,813 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-02-19 21:00:43,813 DEBUG [M:0;jenkins-hbase4:38201] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:43,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:43,813 DEBUG [RegionServerTracker-0] master.ActiveMasterManager(335): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-02-19 21:00:43,813 DEBUG [M:0;jenkins-hbase4:38201] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:43,813 DEBUG [M:0;jenkins-hbase4:38201] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:43,813 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.65 KB heapSize=67.61 KB 2023-02-19 21:00:43,822 INFO [M:0;jenkins-hbase4:38201] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.65 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/605a68d02d334c879c542a15087bc020 2023-02-19 21:00:43,826 DEBUG [M:0;jenkins-hbase4:38201] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/605a68d02d334c879c542a15087bc020 as hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/605a68d02d334c879c542a15087bc020 2023-02-19 21:00:43,829 INFO [M:0;jenkins-hbase4:38201] regionserver.HStore(1080): Added hdfs://localhost:34591/user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/605a68d02d334c879c542a15087bc020, entries=17, sequenceid=132, filesize=8.7 K 2023-02-19 21:00:43,830 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegion(2947): Finished flush of dataSize ~56.65 KB/58009, heapSize ~67.59 KB/69216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-19 21:00:43,830 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:43,830 DEBUG [M:0;jenkins-hbase4:38201] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:43,833 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/392af57e-c8b4-5182-2b01-313bace54ab5/MasterData/WALs/jenkins-hbase4.apache.org,38201,1676840440081/jenkins-hbase4.apache.org%2C38201%2C1676840440081.1676840440233 not finished, retry = 0 2023-02-19 21:00:43,934 INFO [M:0;jenkins-hbase4:38201] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 21:00:43,934 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:43,935 INFO [M:0;jenkins-hbase4:38201] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38201 2023-02-19 21:00:43,936 DEBUG [M:0;jenkins-hbase4:38201] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38201,1676840440081 already deleted, retry=false 2023-02-19 21:00:44,038 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:44,038 INFO [M:0;jenkins-hbase4:38201] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38201,1676840440081; zookeeper connection closed. 2023-02-19 21:00:44,038 ERROR [Listener at localhost/41083-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@52c14de9 rejected from java.util.concurrent.ThreadPoolExecutor@56fec369[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:44,039 DEBUG [Listener at localhost/41083-EventThread] zookeeper.ZKWatcher(600): master:38201-0x1006e627abf0000, quorum=127.0.0.1:59090, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:44,039 ERROR [Listener at localhost/41083-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a5363d4 rejected from java.util.concurrent.ThreadPoolExecutor@56fec369[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:44,039 WARN [Listener at localhost/41083] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:44,043 INFO [Listener at localhost/41083] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:44,145 WARN [BP-925071955-172.31.14.131-1676840439492 heartbeating to localhost/127.0.0.1:34591] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:44,146 WARN [BP-925071955-172.31.14.131-1676840439492 heartbeating to localhost/127.0.0.1:34591] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-925071955-172.31.14.131-1676840439492 (Datanode Uuid 2f467b09-118c-4f73-8b94-6d23dd7f2322) service to localhost/127.0.0.1:34591 2023-02-19 21:00:44,146 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/cluster_9c4f15a4-1fa7-7759-fc4c-225dcd0be016/dfs/data/data3/current/BP-925071955-172.31.14.131-1676840439492] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:44,146 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/cluster_9c4f15a4-1fa7-7759-fc4c-225dcd0be016/dfs/data/data4/current/BP-925071955-172.31.14.131-1676840439492] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:44,147 WARN [Listener at localhost/41083] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:44,150 INFO [Listener at localhost/41083] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:44,254 WARN [BP-925071955-172.31.14.131-1676840439492 heartbeating to localhost/127.0.0.1:34591] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:44,254 WARN [BP-925071955-172.31.14.131-1676840439492 heartbeating to localhost/127.0.0.1:34591] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-925071955-172.31.14.131-1676840439492 (Datanode Uuid 59a628e6-1533-40cd-b464-cd2682f2f673) service to localhost/127.0.0.1:34591 2023-02-19 21:00:44,255 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/cluster_9c4f15a4-1fa7-7759-fc4c-225dcd0be016/dfs/data/data1/current/BP-925071955-172.31.14.131-1676840439492] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:44,255 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/cluster_9c4f15a4-1fa7-7759-fc4c-225dcd0be016/dfs/data/data2/current/BP-925071955-172.31.14.131-1676840439492] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:44,264 INFO [Listener at localhost/41083] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:44,376 INFO [Listener at localhost/41083] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 21:00:44,391 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 21:00:44,402 INFO [Listener at localhost/41083] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=270 (was 250) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34591 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:34591 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:34591 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41083 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38201,1676840440081)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:34591 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:34591 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:34591 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:34591 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=571 (was 642), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=287 (was 294), ProcessCount=170 (was 170), AvailableMemoryMB=8838 (was 8869) 2023-02-19 21:00:44,413 INFO [Listener at localhost/41083] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=270, OpenFileDescriptor=571, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=170, AvailableMemoryMB=8838 2023-02-19 21:00:44,423 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/hadoop.log.dir so I do NOT create it in target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702 2023-02-19 21:00:44,423 WARN [Listener at localhost/41083] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 21:00:44,423 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/hadoop.tmp.dir so I do NOT create it in target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702 2023-02-19 21:00:44,423 WARN [Listener at localhost/41083] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2c5326dc-a424-c8be-54b7-83d5f0e196bd/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 21:00:44,423 DEBUG [Listener at localhost/41083] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702 2023-02-19 21:00:44,423 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 21:00:44,423 INFO [Listener at localhost/41083] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/cluster_4e74e50e-0cd4-ccae-22f9-262a93ec5e29, deleteOnExit=true 2023-02-19 21:00:44,423 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 21:00:44,424 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/test.cache.data in system properties and HBase conf 2023-02-19 21:00:44,424 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 21:00:44,424 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/hadoop.log.dir in system properties and HBase conf 2023-02-19 21:00:44,424 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 21:00:44,424 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 21:00:44,424 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 21:00:44,424 DEBUG [Listener at localhost/41083] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 21:00:44,424 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 21:00:44,424 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 21:00:44,424 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 21:00:44,425 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 21:00:44,425 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 21:00:44,425 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 21:00:44,425 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 21:00:44,425 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 21:00:44,425 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 21:00:44,425 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/nfs.dump.dir in system properties and HBase conf 2023-02-19 21:00:44,425 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/java.io.tmpdir in system properties and HBase conf 2023-02-19 21:00:44,425 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 21:00:44,425 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 21:00:44,425 INFO [Listener at localhost/41083] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 21:00:44,429 WARN [Listener at localhost/41083] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 21:00:44,430 WARN [Listener at localhost/41083] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 21:00:44,465 WARN [Listener at localhost/41083] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:44,467 INFO [Listener at localhost/41083] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:44,474 INFO [Listener at localhost/41083] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/java.io.tmpdir/Jetty_localhost_39187_hdfs____gr0odw/webapp 2023-02-19 21:00:44,569 INFO [Listener at localhost/41083] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39187 2023-02-19 21:00:44,574 WARN [Listener at localhost/41083] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 21:00:44,574 WARN [Listener at localhost/41083] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 21:00:44,618 WARN [Listener at localhost/36017] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:44,628 WARN [Listener at localhost/36017] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 21:00:44,630 WARN [Listener at localhost/36017] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:44,631 INFO [Listener at localhost/36017] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:44,638 INFO [Listener at localhost/36017] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/java.io.tmpdir/Jetty_localhost_44867_datanode____nnrlcw/webapp 2023-02-19 21:00:44,736 INFO [Listener at localhost/36017] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44867 2023-02-19 21:00:44,746 WARN [Listener at localhost/45609] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:44,757 WARN [Listener at localhost/45609] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 21:00:44,760 WARN [Listener at localhost/45609] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 21:00:44,761 INFO [Listener at localhost/45609] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 21:00:44,764 INFO [Listener at localhost/45609] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/java.io.tmpdir/Jetty_localhost_44305_datanode____twfuu7/webapp 2023-02-19 21:00:44,846 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa8df26482ea487da: Processing first storage report for DS-52025b73-3908-413f-97c8-6eda23e038f0 from datanode 01ea87ad-b362-4e93-aeb2-1b1ff522b4bd 2023-02-19 21:00:44,846 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa8df26482ea487da: from storage DS-52025b73-3908-413f-97c8-6eda23e038f0 node DatanodeRegistration(127.0.0.1:46623, datanodeUuid=01ea87ad-b362-4e93-aeb2-1b1ff522b4bd, infoPort=37393, infoSecurePort=0, ipcPort=45609, storageInfo=lv=-57;cid=testClusterID;nsid=1204912485;c=1676840444432), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:44,846 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa8df26482ea487da: Processing first storage report for DS-3cbeeae5-720c-4f60-b0f4-0ef11f4cf323 from datanode 01ea87ad-b362-4e93-aeb2-1b1ff522b4bd 2023-02-19 21:00:44,846 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa8df26482ea487da: from storage DS-3cbeeae5-720c-4f60-b0f4-0ef11f4cf323 node DatanodeRegistration(127.0.0.1:46623, datanodeUuid=01ea87ad-b362-4e93-aeb2-1b1ff522b4bd, infoPort=37393, infoSecurePort=0, ipcPort=45609, storageInfo=lv=-57;cid=testClusterID;nsid=1204912485;c=1676840444432), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:44,876 INFO [Listener at localhost/45609] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44305 2023-02-19 21:00:44,887 WARN [Listener at localhost/43483] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 21:00:44,983 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x158894aadde002ad: Processing first storage report for DS-1c872356-0eb3-444f-958b-52b3eec07542 from datanode 608af996-f4de-4668-90bb-db920c42fddb 2023-02-19 21:00:44,983 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x158894aadde002ad: from storage DS-1c872356-0eb3-444f-958b-52b3eec07542 node DatanodeRegistration(127.0.0.1:37453, datanodeUuid=608af996-f4de-4668-90bb-db920c42fddb, infoPort=33129, infoSecurePort=0, ipcPort=43483, storageInfo=lv=-57;cid=testClusterID;nsid=1204912485;c=1676840444432), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:44,983 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x158894aadde002ad: Processing first storage report for DS-115233c9-11d7-421e-8cbc-201dbd154081 from datanode 608af996-f4de-4668-90bb-db920c42fddb 2023-02-19 21:00:44,983 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x158894aadde002ad: from storage DS-115233c9-11d7-421e-8cbc-201dbd154081 node DatanodeRegistration(127.0.0.1:37453, datanodeUuid=608af996-f4de-4668-90bb-db920c42fddb, infoPort=33129, infoSecurePort=0, ipcPort=43483, storageInfo=lv=-57;cid=testClusterID;nsid=1204912485;c=1676840444432), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 21:00:44,998 DEBUG [Listener at localhost/43483] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702 2023-02-19 21:00:45,000 INFO [Listener at localhost/43483] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/cluster_4e74e50e-0cd4-ccae-22f9-262a93ec5e29/zookeeper_0, clientPort=56339, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/cluster_4e74e50e-0cd4-ccae-22f9-262a93ec5e29/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/cluster_4e74e50e-0cd4-ccae-22f9-262a93ec5e29/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 21:00:45,001 INFO [Listener at localhost/43483] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56339 2023-02-19 21:00:45,001 INFO [Listener at localhost/43483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:45,002 INFO [Listener at localhost/43483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:45,020 INFO [Listener at localhost/43483] util.FSUtils(479): Created version file at hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5 with version=8 2023-02-19 21:00:45,020 INFO [Listener at localhost/43483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:45,021 INFO [Listener at localhost/43483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:45,022 INFO [Listener at localhost/43483] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36017/user/jenkins/test-data/5d8f1102-918f-a66b-3ccf-f635f0d43128/hbase-staging 2023-02-19 21:00:45,024 INFO [Listener at localhost/43483] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:45,024 INFO [Listener at localhost/43483] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:45,024 INFO [Listener at localhost/43483] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:45,024 INFO [Listener at localhost/43483] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:45,024 INFO [Listener at localhost/43483] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:45,024 INFO [Listener at localhost/43483] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:45,024 INFO [Listener at localhost/43483] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:45,025 INFO [Listener at localhost/43483] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40373 2023-02-19 21:00:45,025 INFO [Listener at localhost/43483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:45,026 INFO [Listener at localhost/43483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:45,027 INFO [Listener at localhost/43483] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40373 connecting to ZooKeeper ensemble=127.0.0.1:56339 2023-02-19 21:00:45,034 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:403730x0, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:45,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40373-0x1006e628e0c0000 connected 2023-02-19 21:00:45,058 DEBUG [Listener at localhost/43483] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:45,058 DEBUG [Listener at localhost/43483] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:45,059 DEBUG [Listener at localhost/43483] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:45,060 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40373 2023-02-19 21:00:45,064 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40373 2023-02-19 21:00:45,064 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40373 2023-02-19 21:00:45,064 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40373 2023-02-19 21:00:45,065 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40373 2023-02-19 21:00:45,065 INFO [Listener at localhost/43483] master.HMaster(444): hbase.rootdir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5, hbase.cluster.distributed=false 2023-02-19 21:00:45,078 INFO [Listener at localhost/43483] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:45,078 INFO [Listener at localhost/43483] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:45,078 INFO [Listener at localhost/43483] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:45,078 INFO [Listener at localhost/43483] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:45,078 INFO [Listener at localhost/43483] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:45,078 INFO [Listener at localhost/43483] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:45,078 INFO [Listener at localhost/43483] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:45,079 INFO [Listener at localhost/43483] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36115 2023-02-19 21:00:45,080 INFO [Listener at localhost/43483] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 21:00:45,082 DEBUG [Listener at localhost/43483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:45,083 INFO [Listener at localhost/43483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:45,084 INFO [Listener at localhost/43483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:45,085 INFO [Listener at localhost/43483] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36115 connecting to ZooKeeper ensemble=127.0.0.1:56339 2023-02-19 21:00:45,087 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:361150x0, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:45,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36115-0x1006e628e0c0001 connected 2023-02-19 21:00:45,090 DEBUG [Listener at localhost/43483] zookeeper.ZKUtil(164): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:45,091 DEBUG [Listener at localhost/43483] zookeeper.ZKUtil(164): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:45,091 DEBUG [Listener at localhost/43483] zookeeper.ZKUtil(164): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:45,092 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36115 2023-02-19 21:00:45,092 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36115 2023-02-19 21:00:45,092 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36115 2023-02-19 21:00:45,096 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36115 2023-02-19 21:00:45,096 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36115 2023-02-19 21:00:45,107 INFO [Listener at localhost/43483] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 21:00:45,107 INFO [Listener at localhost/43483] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:45,107 INFO [Listener at localhost/43483] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:45,107 INFO [Listener at localhost/43483] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 21:00:45,107 INFO [Listener at localhost/43483] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 21:00:45,107 INFO [Listener at localhost/43483] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 21:00:45,107 INFO [Listener at localhost/43483] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 21:00:45,108 INFO [Listener at localhost/43483] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42621 2023-02-19 21:00:45,108 INFO [Listener at localhost/43483] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 21:00:45,108 DEBUG [Listener at localhost/43483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:45,109 INFO [Listener at localhost/43483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:45,110 INFO [Listener at localhost/43483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:45,110 INFO [Listener at localhost/43483] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42621 connecting to ZooKeeper ensemble=127.0.0.1:56339 2023-02-19 21:00:45,112 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:426210x0, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 21:00:45,113 DEBUG [Listener at localhost/43483] zookeeper.ZKUtil(164): regionserver:426210x0, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:45,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42621-0x1006e628e0c0002 connected 2023-02-19 21:00:45,114 DEBUG [Listener at localhost/43483] zookeeper.ZKUtil(164): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:45,114 DEBUG [Listener at localhost/43483] zookeeper.ZKUtil(164): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 21:00:45,114 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42621 2023-02-19 21:00:45,115 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42621 2023-02-19 21:00:45,115 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42621 2023-02-19 21:00:45,115 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42621 2023-02-19 21:00:45,115 DEBUG [Listener at localhost/43483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42621 2023-02-19 21:00:45,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40373,1676840445023 2023-02-19 21:00:45,119 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 21:00:45,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40373,1676840445023 2023-02-19 21:00:45,121 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:45,121 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:45,121 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:45,123 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:45,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 21:00:45,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40373,1676840445023 from backup master directory 2023-02-19 21:00:45,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 21:00:45,125 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40373,1676840445023 2023-02-19 21:00:45,125 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 21:00:45,125 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:45,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40373,1676840445023 2023-02-19 21:00:45,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/hbase.id with ID: 96ec3602-2944-480d-a235-1ba116b3e847 2023-02-19 21:00:45,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 21:00:45,143 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:45,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x78af419f to 127.0.0.1:56339 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:45,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d4d4463, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:45,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:45,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 21:00:45,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:45,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/data/master/store-tmp 2023-02-19 21:00:45,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:45,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:45,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:45,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:45,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:45,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:45,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:45,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:45,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/WALs/jenkins-hbase4.apache.org,40373,1676840445023 2023-02-19 21:00:45,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40373%2C1676840445023, suffix=, logDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/WALs/jenkins-hbase4.apache.org,40373,1676840445023, archiveDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/oldWALs, maxLogs=10 2023-02-19 21:00:45,177 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37453,DS-1c872356-0eb3-444f-958b-52b3eec07542,DISK] 2023-02-19 21:00:45,178 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46623,DS-52025b73-3908-413f-97c8-6eda23e038f0,DISK] 2023-02-19 21:00:45,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/WALs/jenkins-hbase4.apache.org,40373,1676840445023/jenkins-hbase4.apache.org%2C40373%2C1676840445023.1676840445165 2023-02-19 21:00:45,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37453,DS-1c872356-0eb3-444f-958b-52b3eec07542,DISK], DatanodeInfoWithStorage[127.0.0.1:46623,DS-52025b73-3908-413f-97c8-6eda23e038f0,DISK]] 2023-02-19 21:00:45,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:45,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:45,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:45,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:45,183 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:45,185 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 21:00:45,185 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 21:00:45,185 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:45,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:45,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:45,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 21:00:45,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:45,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64957048, jitterRate=-0.03206455707550049}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 21:00:45,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:45,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 21:00:45,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 21:00:45,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 21:00:45,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 21:00:45,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 21:00:45,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 21:00:45,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 21:00:45,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 21:00:45,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 21:00:45,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 21:00:45,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 21:00:45,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 21:00:45,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 21:00:45,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 21:00:45,208 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:45,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 21:00:45,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 21:00:45,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 21:00:45,210 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:45,210 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:45,210 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:45,210 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:45,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40373,1676840445023, sessionid=0x1006e628e0c0000, setting cluster-up flag (Was=false) 2023-02-19 21:00:45,216 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:45,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 21:00:45,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40373,1676840445023 2023-02-19 21:00:45,223 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:45,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 21:00:45,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40373,1676840445023 2023-02-19 21:00:45,228 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.hbase-snapshot/.tmp 2023-02-19 21:00:45,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:45,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:45,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:45,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:45,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 21:00:45,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 21:00:45,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:45,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676840475231 2023-02-19 21:00:45,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 21:00:45,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 21:00:45,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 21:00:45,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 21:00:45,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 21:00:45,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 21:00:45,231 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:45,231 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 21:00:45,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 21:00:45,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 21:00:45,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 21:00:45,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 21:00:45,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 21:00:45,232 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:45,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840445232,5,FailOnTimeoutGroup] 2023-02-19 21:00:45,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840445233,5,FailOnTimeoutGroup] 2023-02-19 21:00:45,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 21:00:45,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,239 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:45,239 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:45,239 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5 2023-02-19 21:00:45,244 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:45,245 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 21:00:45,246 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/info 2023-02-19 21:00:45,246 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 21:00:45,246 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:45,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 21:00:45,247 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:45,247 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 21:00:45,248 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:45,248 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 21:00:45,249 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/table 2023-02-19 21:00:45,249 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 21:00:45,249 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:45,250 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740 2023-02-19 21:00:45,250 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740 2023-02-19 21:00:45,251 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 21:00:45,252 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 21:00:45,253 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:45,253 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61670411, jitterRate=-0.08103926479816437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 21:00:45,253 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 21:00:45,253 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:45,253 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:45,253 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:45,253 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:45,253 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:45,254 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:45,254 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:45,254 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 21:00:45,254 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 21:00:45,254 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 21:00:45,255 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 21:00:45,256 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 21:00:45,317 INFO [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(952): ClusterId : 96ec3602-2944-480d-a235-1ba116b3e847 2023-02-19 21:00:45,317 INFO [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(952): ClusterId : 96ec3602-2944-480d-a235-1ba116b3e847 2023-02-19 21:00:45,318 DEBUG [RS:1;jenkins-hbase4:42621] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 21:00:45,318 DEBUG [RS:0;jenkins-hbase4:36115] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 21:00:45,319 DEBUG [RS:0;jenkins-hbase4:36115] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 21:00:45,319 DEBUG [RS:0;jenkins-hbase4:36115] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 21:00:45,319 DEBUG [RS:1;jenkins-hbase4:42621] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 21:00:45,319 DEBUG [RS:1;jenkins-hbase4:42621] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 21:00:45,321 DEBUG [RS:0;jenkins-hbase4:36115] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 21:00:45,322 DEBUG [RS:1;jenkins-hbase4:42621] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 21:00:45,322 DEBUG [RS:0;jenkins-hbase4:36115] zookeeper.ReadOnlyZKClient(139): Connect 0x71f62b76 to 127.0.0.1:56339 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:45,323 DEBUG [RS:1;jenkins-hbase4:42621] zookeeper.ReadOnlyZKClient(139): Connect 0x42b174f4 to 127.0.0.1:56339 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:45,331 DEBUG [RS:0;jenkins-hbase4:36115] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f31cb38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:45,332 DEBUG [RS:1;jenkins-hbase4:42621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c7692d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:45,332 DEBUG [RS:0;jenkins-hbase4:36115] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b0e4006, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:45,332 DEBUG [RS:1;jenkins-hbase4:42621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48491f84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:45,341 DEBUG [RS:0;jenkins-hbase4:36115] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36115 2023-02-19 21:00:45,341 DEBUG [RS:1;jenkins-hbase4:42621] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42621 2023-02-19 21:00:45,341 INFO [RS:0;jenkins-hbase4:36115] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 21:00:45,341 INFO [RS:0;jenkins-hbase4:36115] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 21:00:45,341 INFO [RS:1;jenkins-hbase4:42621] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 21:00:45,341 INFO [RS:1;jenkins-hbase4:42621] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 21:00:45,341 DEBUG [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 21:00:45,341 DEBUG [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 21:00:45,341 INFO [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40373,1676840445023 with isa=jenkins-hbase4.apache.org/172.31.14.131:42621, startcode=1676840445106 2023-02-19 21:00:45,341 INFO [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40373,1676840445023 with isa=jenkins-hbase4.apache.org/172.31.14.131:36115, startcode=1676840445077 2023-02-19 21:00:45,341 DEBUG [RS:1;jenkins-hbase4:42621] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 21:00:45,341 DEBUG [RS:0;jenkins-hbase4:36115] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 21:00:45,343 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48023, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 21:00:45,343 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35079, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 21:00:45,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40373] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:45,345 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:45,345 DEBUG [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5 2023-02-19 21:00:45,345 DEBUG [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36017 2023-02-19 21:00:45,345 DEBUG [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5 2023-02-19 21:00:45,345 DEBUG [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 21:00:45,345 DEBUG [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36017 2023-02-19 21:00:45,345 DEBUG [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 21:00:45,349 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:45,350 DEBUG [RS:1;jenkins-hbase4:42621] zookeeper.ZKUtil(162): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:45,350 DEBUG [RS:0;jenkins-hbase4:36115] zookeeper.ZKUtil(162): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:45,350 WARN [RS:1;jenkins-hbase4:42621] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:45,350 WARN [RS:0;jenkins-hbase4:36115] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 21:00:45,350 INFO [RS:1;jenkins-hbase4:42621] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:45,350 INFO [RS:0;jenkins-hbase4:36115] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:45,350 DEBUG [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/WALs/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:45,350 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36115,1676840445077] 2023-02-19 21:00:45,351 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42621,1676840445106] 2023-02-19 21:00:45,350 DEBUG [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/WALs/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:45,355 DEBUG [RS:0;jenkins-hbase4:36115] zookeeper.ZKUtil(162): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:45,355 DEBUG [RS:1;jenkins-hbase4:42621] zookeeper.ZKUtil(162): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:45,356 DEBUG [RS:0;jenkins-hbase4:36115] zookeeper.ZKUtil(162): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:45,356 DEBUG [RS:1;jenkins-hbase4:42621] zookeeper.ZKUtil(162): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:45,356 DEBUG [RS:0;jenkins-hbase4:36115] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 21:00:45,356 DEBUG [RS:1;jenkins-hbase4:42621] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 21:00:45,356 INFO [RS:0;jenkins-hbase4:36115] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 21:00:45,356 INFO [RS:1;jenkins-hbase4:42621] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 21:00:45,358 INFO [RS:0;jenkins-hbase4:36115] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 21:00:45,360 INFO [RS:0;jenkins-hbase4:36115] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 21:00:45,360 INFO [RS:1;jenkins-hbase4:42621] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 21:00:45,360 INFO [RS:0;jenkins-hbase4:36115] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,365 INFO [RS:1;jenkins-hbase4:42621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 21:00:45,365 INFO [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 21:00:45,365 INFO [RS:1;jenkins-hbase4:42621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,367 INFO [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 21:00:45,369 INFO [RS:0;jenkins-hbase4:36115] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,370 DEBUG [RS:0;jenkins-hbase4:36115] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 DEBUG [RS:0;jenkins-hbase4:36115] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 DEBUG [RS:0;jenkins-hbase4:36115] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 INFO [RS:1;jenkins-hbase4:42621] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,370 DEBUG [RS:0;jenkins-hbase4:36115] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 DEBUG [RS:0;jenkins-hbase4:36115] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 DEBUG [RS:1;jenkins-hbase4:42621] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 DEBUG [RS:0;jenkins-hbase4:36115] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:45,370 DEBUG [RS:1;jenkins-hbase4:42621] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 DEBUG [RS:0;jenkins-hbase4:36115] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 DEBUG [RS:1;jenkins-hbase4:42621] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 DEBUG [RS:0;jenkins-hbase4:36115] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 DEBUG [RS:1;jenkins-hbase4:42621] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 DEBUG [RS:0;jenkins-hbase4:36115] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 DEBUG [RS:1;jenkins-hbase4:42621] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,370 DEBUG [RS:0;jenkins-hbase4:36115] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,371 DEBUG [RS:1;jenkins-hbase4:42621] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 21:00:45,371 DEBUG [RS:1;jenkins-hbase4:42621] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,371 DEBUG [RS:1;jenkins-hbase4:42621] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,371 DEBUG [RS:1;jenkins-hbase4:42621] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,371 DEBUG [RS:1;jenkins-hbase4:42621] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 21:00:45,372 INFO [RS:0;jenkins-hbase4:36115] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,372 INFO [RS:0;jenkins-hbase4:36115] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,372 INFO [RS:0;jenkins-hbase4:36115] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,375 INFO [RS:1;jenkins-hbase4:42621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,375 INFO [RS:1;jenkins-hbase4:42621] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,375 INFO [RS:1;jenkins-hbase4:42621] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,383 INFO [RS:0;jenkins-hbase4:36115] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 21:00:45,383 INFO [RS:0;jenkins-hbase4:36115] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36115,1676840445077-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,386 INFO [RS:1;jenkins-hbase4:42621] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 21:00:45,386 INFO [RS:1;jenkins-hbase4:42621] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42621,1676840445106-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,397 INFO [RS:0;jenkins-hbase4:36115] regionserver.Replication(203): jenkins-hbase4.apache.org,36115,1676840445077 started 2023-02-19 21:00:45,397 INFO [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36115,1676840445077, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36115, sessionid=0x1006e628e0c0001 2023-02-19 21:00:45,397 INFO [RS:1;jenkins-hbase4:42621] regionserver.Replication(203): jenkins-hbase4.apache.org,42621,1676840445106 started 2023-02-19 21:00:45,397 DEBUG [RS:0;jenkins-hbase4:36115] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 21:00:45,397 DEBUG [RS:0;jenkins-hbase4:36115] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:45,397 DEBUG [RS:0;jenkins-hbase4:36115] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36115,1676840445077' 2023-02-19 21:00:45,397 DEBUG [RS:0;jenkins-hbase4:36115] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:45,397 INFO [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42621,1676840445106, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42621, sessionid=0x1006e628e0c0002 2023-02-19 21:00:45,397 DEBUG [RS:1;jenkins-hbase4:42621] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 21:00:45,397 DEBUG [RS:1;jenkins-hbase4:42621] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:45,397 DEBUG [RS:1;jenkins-hbase4:42621] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42621,1676840445106' 2023-02-19 21:00:45,397 DEBUG [RS:1;jenkins-hbase4:42621] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:45,398 DEBUG [RS:0;jenkins-hbase4:36115] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:45,398 DEBUG [RS:1;jenkins-hbase4:42621] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:45,398 DEBUG [RS:0;jenkins-hbase4:36115] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 21:00:45,398 DEBUG [RS:0;jenkins-hbase4:36115] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 21:00:45,398 DEBUG [RS:0;jenkins-hbase4:36115] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:45,398 DEBUG [RS:0;jenkins-hbase4:36115] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36115,1676840445077' 2023-02-19 21:00:45,398 DEBUG [RS:0;jenkins-hbase4:36115] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:45,398 DEBUG [RS:1;jenkins-hbase4:42621] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 21:00:45,398 DEBUG [RS:1;jenkins-hbase4:42621] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 21:00:45,398 DEBUG [RS:1;jenkins-hbase4:42621] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:45,398 DEBUG [RS:1;jenkins-hbase4:42621] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42621,1676840445106' 2023-02-19 21:00:45,398 DEBUG [RS:1;jenkins-hbase4:42621] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:45,398 DEBUG [RS:0;jenkins-hbase4:36115] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:45,398 DEBUG [RS:1;jenkins-hbase4:42621] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:45,398 DEBUG [RS:0;jenkins-hbase4:36115] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 21:00:45,398 INFO [RS:0;jenkins-hbase4:36115] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 21:00:45,399 INFO [RS:0;jenkins-hbase4:36115] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 21:00:45,399 DEBUG [RS:1;jenkins-hbase4:42621] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 21:00:45,399 INFO [RS:1;jenkins-hbase4:42621] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 21:00:45,399 INFO [RS:1;jenkins-hbase4:42621] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 21:00:45,406 DEBUG [jenkins-hbase4:40373] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 21:00:45,407 DEBUG [jenkins-hbase4:40373] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:45,408 DEBUG [jenkins-hbase4:40373] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:45,408 DEBUG [jenkins-hbase4:40373] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:45,408 DEBUG [jenkins-hbase4:40373] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:45,408 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36115,1676840445077, state=OPENING 2023-02-19 21:00:45,410 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 21:00:45,411 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:45,412 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 21:00:45,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36115,1676840445077}] 2023-02-19 21:00:45,566 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:45,566 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 21:00:45,568 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42598, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 21:00:45,571 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 21:00:45,572 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 21:00:45,573 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36115%2C1676840445077.meta, suffix=.meta, logDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/WALs/jenkins-hbase4.apache.org,36115,1676840445077, archiveDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/oldWALs, maxLogs=32 2023-02-19 21:00:45,587 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46623,DS-52025b73-3908-413f-97c8-6eda23e038f0,DISK] 2023-02-19 21:00:45,587 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37453,DS-1c872356-0eb3-444f-958b-52b3eec07542,DISK] 2023-02-19 21:00:45,589 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/WALs/jenkins-hbase4.apache.org,36115,1676840445077/jenkins-hbase4.apache.org%2C36115%2C1676840445077.meta.1676840445573.meta 2023-02-19 21:00:45,589 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46623,DS-52025b73-3908-413f-97c8-6eda23e038f0,DISK], DatanodeInfoWithStorage[127.0.0.1:37453,DS-1c872356-0eb3-444f-958b-52b3eec07542,DISK]] 2023-02-19 21:00:45,589 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:45,589 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 21:00:45,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 21:00:45,590 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 21:00:45,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 21:00:45,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:45,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 21:00:45,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 21:00:45,591 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 21:00:45,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/info 2023-02-19 21:00:45,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/info 2023-02-19 21:00:45,592 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 21:00:45,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:45,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 21:00:45,593 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:45,593 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/rep_barrier 2023-02-19 21:00:45,594 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 21:00:45,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:45,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 21:00:45,595 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/table 2023-02-19 21:00:45,595 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/table 2023-02-19 21:00:45,595 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 21:00:45,595 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:45,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740 2023-02-19 21:00:45,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740 2023-02-19 21:00:45,598 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 21:00:45,599 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 21:00:45,599 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60078157, jitterRate=-0.10476569831371307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 21:00:45,599 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 21:00:45,600 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676840445566 2023-02-19 21:00:45,603 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 21:00:45,603 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 21:00:45,604 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36115,1676840445077, state=OPEN 2023-02-19 21:00:45,605 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 21:00:45,605 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 21:00:45,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 21:00:45,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36115,1676840445077 in 193 msec 2023-02-19 21:00:45,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 21:00:45,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-19 21:00:45,609 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 380 msec 2023-02-19 21:00:45,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676840445609, completionTime=-1 2023-02-19 21:00:45,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 21:00:45,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 21:00:45,611 DEBUG [hconnection-0x53d0a515-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:45,612 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42604, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:45,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 21:00:45,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676840505613 2023-02-19 21:00:45,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676840565613 2023-02-19 21:00:45,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-19 21:00:45,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40373,1676840445023-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40373,1676840445023-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40373,1676840445023-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40373, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 21:00:45,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 21:00:45,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:45,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 21:00:45,623 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 21:00:45,623 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 21:00:45,624 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 21:00:45,625 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0 2023-02-19 21:00:45,626 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0 empty. 2023-02-19 21:00:45,626 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0 2023-02-19 21:00:45,626 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 21:00:45,637 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:45,640 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2dbb4cc83834627208302bc9079f0aa0, NAME => 'hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp 2023-02-19 21:00:45,662 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:45,662 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 2dbb4cc83834627208302bc9079f0aa0, disabling compactions & flushes 2023-02-19 21:00:45,662 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. 2023-02-19 21:00:45,662 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. 2023-02-19 21:00:45,662 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. after waiting 0 ms 2023-02-19 21:00:45,662 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. 2023-02-19 21:00:45,662 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. 2023-02-19 21:00:45,662 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 2dbb4cc83834627208302bc9079f0aa0: 2023-02-19 21:00:45,664 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 21:00:45,665 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840445665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840445665"}]},"ts":"1676840445665"} 2023-02-19 21:00:45,669 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 21:00:45,670 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 21:00:45,670 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840445670"}]},"ts":"1676840445670"} 2023-02-19 21:00:45,671 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 21:00:45,674 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:45,674 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:45,674 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:45,674 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:45,674 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2dbb4cc83834627208302bc9079f0aa0, ASSIGN}] 2023-02-19 21:00:45,676 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2dbb4cc83834627208302bc9079f0aa0, ASSIGN 2023-02-19 21:00:45,677 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2dbb4cc83834627208302bc9079f0aa0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42621,1676840445106; forceNewPlan=false, retain=false 2023-02-19 21:00:45,827 INFO [jenkins-hbase4:40373] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 21:00:45,827 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2dbb4cc83834627208302bc9079f0aa0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:45,827 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840445827"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840445827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840445827"}]},"ts":"1676840445827"} 2023-02-19 21:00:45,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2dbb4cc83834627208302bc9079f0aa0, server=jenkins-hbase4.apache.org,42621,1676840445106}] 2023-02-19 21:00:45,982 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:45,982 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 21:00:45,983 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56598, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 21:00:45,987 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. 2023-02-19 21:00:45,988 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42621%2C1676840445106, suffix=, logDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/WALs/jenkins-hbase4.apache.org,42621,1676840445106, archiveDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/oldWALs, maxLogs=32 2023-02-19 21:00:46,002 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46623,DS-52025b73-3908-413f-97c8-6eda23e038f0,DISK] 2023-02-19 21:00:46,003 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37453,DS-1c872356-0eb3-444f-958b-52b3eec07542,DISK] 2023-02-19 21:00:46,005 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/WALs/jenkins-hbase4.apache.org,42621,1676840445106/jenkins-hbase4.apache.org%2C42621%2C1676840445106.1676840445988 2023-02-19 21:00:46,005 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37453,DS-1c872356-0eb3-444f-958b-52b3eec07542,DISK], DatanodeInfoWithStorage[127.0.0.1:46623,DS-52025b73-3908-413f-97c8-6eda23e038f0,DISK]] 2023-02-19 21:00:46,005 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2dbb4cc83834627208302bc9079f0aa0, NAME => 'hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:46,005 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2dbb4cc83834627208302bc9079f0aa0 2023-02-19 21:00:46,005 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:46,005 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2dbb4cc83834627208302bc9079f0aa0 2023-02-19 21:00:46,005 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2dbb4cc83834627208302bc9079f0aa0 2023-02-19 21:00:46,006 INFO [StoreOpener-2dbb4cc83834627208302bc9079f0aa0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2dbb4cc83834627208302bc9079f0aa0 2023-02-19 21:00:46,007 DEBUG [StoreOpener-2dbb4cc83834627208302bc9079f0aa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0/info 2023-02-19 21:00:46,007 DEBUG [StoreOpener-2dbb4cc83834627208302bc9079f0aa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0/info 2023-02-19 21:00:46,008 INFO [StoreOpener-2dbb4cc83834627208302bc9079f0aa0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2dbb4cc83834627208302bc9079f0aa0 columnFamilyName info 2023-02-19 21:00:46,008 INFO [StoreOpener-2dbb4cc83834627208302bc9079f0aa0-1] regionserver.HStore(310): Store=2dbb4cc83834627208302bc9079f0aa0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:46,009 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0 2023-02-19 21:00:46,009 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0 2023-02-19 21:00:46,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2dbb4cc83834627208302bc9079f0aa0 2023-02-19 21:00:46,012 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:46,012 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2dbb4cc83834627208302bc9079f0aa0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74182705, jitterRate=0.1054084450006485}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 21:00:46,013 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2dbb4cc83834627208302bc9079f0aa0: 2023-02-19 21:00:46,013 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0., pid=6, masterSystemTime=1676840445982 2023-02-19 21:00:46,016 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. 2023-02-19 21:00:46,017 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. 2023-02-19 21:00:46,017 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2dbb4cc83834627208302bc9079f0aa0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:46,017 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676840446017"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840446017"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840446017"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840446017"}]},"ts":"1676840446017"} 2023-02-19 21:00:46,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 21:00:46,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2dbb4cc83834627208302bc9079f0aa0, server=jenkins-hbase4.apache.org,42621,1676840445106 in 190 msec 2023-02-19 21:00:46,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 21:00:46,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2dbb4cc83834627208302bc9079f0aa0, ASSIGN in 346 msec 2023-02-19 21:00:46,022 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 21:00:46,022 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840446022"}]},"ts":"1676840446022"} 2023-02-19 21:00:46,023 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 21:00:46,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 21:00:46,025 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 21:00:46,027 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:46,027 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:46,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 404 msec 2023-02-19 21:00:46,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:46,029 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56610, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:46,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 21:00:46,036 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:46,038 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 7 msec 2023-02-19 21:00:46,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 21:00:46,047 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 21:00:46,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-19 21:00:46,055 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 21:00:46,058 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 21:00:46,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.933sec 2023-02-19 21:00:46,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 21:00:46,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 21:00:46,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 21:00:46,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40373,1676840445023-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 21:00:46,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40373,1676840445023-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 21:00:46,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 21:00:46,118 DEBUG [Listener at localhost/43483] zookeeper.ReadOnlyZKClient(139): Connect 0x151c8f86 to 127.0.0.1:56339 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:46,121 DEBUG [Listener at localhost/43483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@177ec98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:46,123 DEBUG [hconnection-0x537c3332-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:46,125 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42616, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:46,127 INFO [Listener at localhost/43483] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40373,1676840445023 2023-02-19 21:00:46,127 DEBUG [Listener at localhost/43483] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 21:00:46,130 DEBUG [Listener at localhost/43483] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 21:00:46,131 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34264, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 21:00:46,131 INFO [Listener at localhost/43483] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 21:00:46,132 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 21:00:46,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 21:00:46,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:34264 deadline: 1676840506132, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-19 21:00:46,132 INFO [Listener at localhost/43483] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-19 21:00:46,134 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 21:00:46,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-19 21:00:46,137 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 21:00:46,137 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-19 21:00:46,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:46,138 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 21:00:46,139 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b 2023-02-19 21:00:46,140 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b empty. 2023-02-19 21:00:46,140 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b 2023-02-19 21:00:46,140 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 21:00:46,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:46,400 INFO [RS:0;jenkins-hbase4:36115] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36115%2C1676840445077, suffix=, logDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/WALs/jenkins-hbase4.apache.org,36115,1676840445077, archiveDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/oldWALs, maxLogs=32 2023-02-19 21:00:46,414 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37453,DS-1c872356-0eb3-444f-958b-52b3eec07542,DISK] 2023-02-19 21:00:46,414 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46623,DS-52025b73-3908-413f-97c8-6eda23e038f0,DISK] 2023-02-19 21:00:46,416 INFO [RS:0;jenkins-hbase4:36115] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/WALs/jenkins-hbase4.apache.org,36115,1676840445077/jenkins-hbase4.apache.org%2C36115%2C1676840445077.1676840446401 2023-02-19 21:00:46,416 DEBUG [RS:0;jenkins-hbase4:36115] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37453,DS-1c872356-0eb3-444f-958b-52b3eec07542,DISK], DatanodeInfoWithStorage[127.0.0.1:46623,DS-52025b73-3908-413f-97c8-6eda23e038f0,DISK]] 2023-02-19 21:00:46,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:46,550 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-19 21:00:46,551 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e529adc54e77727def581e798c82b03b, NAME => 'testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp 2023-02-19 21:00:46,557 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:46,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e529adc54e77727def581e798c82b03b, disabling compactions & flushes 2023-02-19 21:00:46,558 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:46,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:46,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. after waiting 0 ms 2023-02-19 21:00:46,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:46,558 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:46,558 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e529adc54e77727def581e798c82b03b: 2023-02-19 21:00:46,560 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 21:00:46,561 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676840446560"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840446560"}]},"ts":"1676840446560"} 2023-02-19 21:00:46,562 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 21:00:46,563 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 21:00:46,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840446563"}]},"ts":"1676840446563"} 2023-02-19 21:00:46,564 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-19 21:00:46,566 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 21:00:46,567 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 21:00:46,567 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 21:00:46,567 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 21:00:46,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e529adc54e77727def581e798c82b03b, ASSIGN}] 2023-02-19 21:00:46,568 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e529adc54e77727def581e798c82b03b, ASSIGN 2023-02-19 21:00:46,569 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e529adc54e77727def581e798c82b03b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42621,1676840445106; forceNewPlan=false, retain=false 2023-02-19 21:00:46,719 INFO [jenkins-hbase4:40373] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 21:00:46,719 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e529adc54e77727def581e798c82b03b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:46,720 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676840446719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840446719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840446719"}]},"ts":"1676840446719"} 2023-02-19 21:00:46,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure e529adc54e77727def581e798c82b03b, server=jenkins-hbase4.apache.org,42621,1676840445106}] 2023-02-19 21:00:46,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:46,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:46,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e529adc54e77727def581e798c82b03b, NAME => 'testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.', STARTKEY => '', ENDKEY => ''} 2023-02-19 21:00:46,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e529adc54e77727def581e798c82b03b 2023-02-19 21:00:46,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:46,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e529adc54e77727def581e798c82b03b 2023-02-19 21:00:46,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e529adc54e77727def581e798c82b03b 2023-02-19 21:00:46,878 INFO [StoreOpener-e529adc54e77727def581e798c82b03b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e529adc54e77727def581e798c82b03b 2023-02-19 21:00:46,879 DEBUG [StoreOpener-e529adc54e77727def581e798c82b03b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1 2023-02-19 21:00:46,879 DEBUG [StoreOpener-e529adc54e77727def581e798c82b03b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1 2023-02-19 21:00:46,879 INFO [StoreOpener-e529adc54e77727def581e798c82b03b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e529adc54e77727def581e798c82b03b columnFamilyName f1 2023-02-19 21:00:46,880 INFO [StoreOpener-e529adc54e77727def581e798c82b03b-1] regionserver.HStore(310): Store=e529adc54e77727def581e798c82b03b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:46,880 INFO [StoreOpener-e529adc54e77727def581e798c82b03b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e529adc54e77727def581e798c82b03b 2023-02-19 21:00:46,881 DEBUG [StoreOpener-e529adc54e77727def581e798c82b03b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2 2023-02-19 21:00:46,881 DEBUG [StoreOpener-e529adc54e77727def581e798c82b03b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2 2023-02-19 21:00:46,881 INFO [StoreOpener-e529adc54e77727def581e798c82b03b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e529adc54e77727def581e798c82b03b columnFamilyName f2 2023-02-19 21:00:46,882 INFO [StoreOpener-e529adc54e77727def581e798c82b03b-1] regionserver.HStore(310): Store=e529adc54e77727def581e798c82b03b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:46,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b 2023-02-19 21:00:46,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b 2023-02-19 21:00:46,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:46,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e529adc54e77727def581e798c82b03b 2023-02-19 21:00:46,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 21:00:46,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e529adc54e77727def581e798c82b03b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62817000, jitterRate=-0.06395375728607178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:46,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e529adc54e77727def581e798c82b03b: 2023-02-19 21:00:46,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b., pid=12, masterSystemTime=1676840446873 2023-02-19 21:00:46,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:46,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:46,893 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e529adc54e77727def581e798c82b03b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:46,893 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676840446893"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676840446893"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676840446893"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676840446893"}]},"ts":"1676840446893"} 2023-02-19 21:00:46,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-19 21:00:46,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure e529adc54e77727def581e798c82b03b, server=jenkins-hbase4.apache.org,42621,1676840445106 in 173 msec 2023-02-19 21:00:46,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-19 21:00:46,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e529adc54e77727def581e798c82b03b, ASSIGN in 329 msec 2023-02-19 21:00:46,899 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 21:00:46,899 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840446899"}]},"ts":"1676840446899"} 2023-02-19 21:00:46,900 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-19 21:00:46,903 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 21:00:46,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 769 msec 2023-02-19 21:00:47,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 21:00:47,243 INFO [Listener at localhost/43483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-19 21:00:47,243 DEBUG [Listener at localhost/43483] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-19 21:00:47,244 INFO [Listener at localhost/43483] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 21:00:47,246 INFO [Listener at localhost/43483] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-19 21:00:47,246 INFO [Listener at localhost/43483] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 21:00:47,246 INFO [Listener at localhost/43483] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-19 21:00:47,246 INFO [Listener at localhost/43483] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 21:00:47,262 DEBUG [hconnection-0x537c3332-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:47,273 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56614, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:47,286 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42621] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:47,371 INFO [Listener at localhost/43483] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 21:00:47,371 INFO [Listener at localhost/43483] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 21:00:47,372 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 21:00:47,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676840447372 (current time:1676840447372). 2023-02-19 21:00:47,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 21:00:47,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] zookeeper.ReadOnlyZKClient(139): Connect 0x69b10999 to 127.0.0.1:56339 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 21:00:47,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cc6c66a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 21:00:47,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 21:00:47,377 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42630, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 21:00:47,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69b10999 to 127.0.0.1:56339 2023-02-19 21:00:47,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:47,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 21:00:47,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 21:00:47,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 21:00:47,382 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 21:00:47,383 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676841047383 2023-02-19 21:00:47,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 21:00:47,383 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-19 21:00:47,383 DEBUG [Listener at localhost/43483] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:47,383 DEBUG [Listener at localhost/43483] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 21:00:47,387 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 21:00:47,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 21:00:47,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 7 msec 2023-02-19 21:00:47,388 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 21:00:47,389 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676841047389 2023-02-19 21:00:47,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-19 21:00:47,400 INFO [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-19 21:00:47,400 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:47,401 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-19 21:00:47,401 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-19 21:00:47,481 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,481 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 21:00:47,483 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:47,483 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:47,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:47,483 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:47,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:47,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:47,483 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,483 DEBUG [Listener at localhost/43483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:47,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 21:00:47,483 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:47,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 21:00:47,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-19 21:00:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 21:00:47,484 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-19 21:00:47,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 21:00:47,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 21:00:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-19 21:00:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 21:00:47,485 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-19 21:00:47,485 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-19 21:00:47,485 DEBUG [Listener at localhost/43483] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 21:00:47,485 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-19 21:00:47,485 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-19 21:00:47,485 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:47,485 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-19 21:00:47,486 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 21:00:47,486 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 21:00:47,486 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-19 21:00:47,489 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36115,1676840445077' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-19 21:00:47,489 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 21:00:47,489 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-19 21:00:47,489 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42621,1676840445106' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-19 21:00:47,490 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,490 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,490 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:47,491 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,491 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,491 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:47,491 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 21:00:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:47,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42621,1676840445106' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-19 21:00:47,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49e5941c[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:47,492 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-19 21:00:47,492 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,493 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,493 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,494 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 21:00:47,494 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-19 21:00:47,494 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,36115,1676840445077' in zk 2023-02-19 21:00:47,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,494 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,494 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:47,494 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 21:00:47,494 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-19 21:00:47,494 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 21:00:47,494 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:47,494 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. started... 2023-02-19 21:00:47,494 INFO [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e529adc54e77727def581e798c82b03b 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-19 21:00:47,495 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-19 21:00:47,495 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:47,495 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-19 21:00:47,512 INFO [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/.tmp/f1/50f7a60bf86e490989046e4823c78d69 2023-02-19 21:00:47,530 INFO [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/.tmp/f2/f08e2382262b447d90f690a8f000bd27 2023-02-19 21:00:47,534 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/.tmp/f1/50f7a60bf86e490989046e4823c78d69 as hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1/50f7a60bf86e490989046e4823c78d69 2023-02-19 21:00:47,537 INFO [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1/50f7a60bf86e490989046e4823c78d69, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 21:00:47,538 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/.tmp/f2/f08e2382262b447d90f690a8f000bd27 as hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2/f08e2382262b447d90f690a8f000bd27 2023-02-19 21:00:47,541 INFO [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2/f08e2382262b447d90f690a8f000bd27, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 21:00:47,542 INFO [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for e529adc54e77727def581e798c82b03b in 48ms, sequenceid=5, compaction requested=false 2023-02-19 21:00:47,542 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e529adc54e77727def581e798c82b03b: 2023-02-19 21:00:47,542 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-19 21:00:47,542 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 21:00:47,542 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1/50f7a60bf86e490989046e4823c78d69] hfiles 2023-02-19 21:00:47,542 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1/50f7a60bf86e490989046e4823c78d69 for snapshot=testWithMapReduceSingleRegion 2023-02-19 21:00:47,542 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2/f08e2382262b447d90f690a8f000bd27] hfiles 2023-02-19 21:00:47,542 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2/f08e2382262b447d90f690a8f000bd27 for snapshot=testWithMapReduceSingleRegion 2023-02-19 21:00:47,554 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. completed. 2023-02-19 21:00:47,554 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:47,554 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-19 21:00:47,554 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-19 21:00:47,554 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,554 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-19 21:00:47,554 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,42621,1676840445106' in zk 2023-02-19 21:00:47,556 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-19 21:00:47,557 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,557 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:47,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,557 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-19 21:00:47,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:47,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:47,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:47,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:47,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 21:00:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 21:00:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,42621,1676840445106': 2023-02-19 21:00:47,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42621,1676840445106' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-19 21:00:47,559 INFO [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-19 21:00:47,559 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:47,559 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:47,559 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-19 21:00:47,559 INFO [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 21:00:47,561 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,561 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,561 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:47,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,561 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:47,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,561 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:47,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 21:00:47,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:47,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:47,561 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:47,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:47,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:47,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,562 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 21:00:47,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:47,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 21:00:47,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,563 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:47,564 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 21:00:47,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,568 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,568 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:47,568 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 21:00:47,568 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 21:00:47,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:47,568 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:47,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 21:00:47,569 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:47,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-19 21:00:47,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:47,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-19 21:00:47,569 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 21:00:47,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 21:00:47,568 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,569 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 21:00:47,569 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,569 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,569 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,569 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 21:00:47,569 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 21:00:47,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:47,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 21:00:47,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:47,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-19 21:00:47,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 21:00:47,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-19 21:00:47,605 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-19 21:00:47,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-19 21:00:47,605 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-19 21:00:47,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676840447383Consolidate snapshot: testWithMapReduceSingleRegion at 1676840447569 (+186 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676840447569Writing data manifest for testWithMapReduceSingleRegion at 1676840447571 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676840447580 (+9 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676840447605 (+25 ms) 2023-02-19 21:00:47,605 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 21:00:47,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 219 msec 2023-02-19 21:00:47,685 DEBUG [Listener at localhost/43483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 21:00:47,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 21:00:47,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 21:00:47,686 INFO [Listener at localhost/43483] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 21:00:47,690 INFO [Listener at localhost/43483] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 21:00:47,694 INFO [Listener at localhost/43483] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 21:00:47,721 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42621] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:47,806 INFO [Listener at localhost/43483] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 21:00:47,810 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 21:00:47,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-19 21:00:47,812 INFO [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-19 21:00:47,812 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:47,812 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-19 21:00:47,812 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-19 21:00:47,813 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,813 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:47,815 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:47,815 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:47,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:47,815 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:47,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:47,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:47,815 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,815 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 21:00:47,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:47,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:47,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:47,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:47,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 21:00:47,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:47,816 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 21:00:47,816 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 21:00:47,816 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 21:00:47,816 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 21:00:47,817 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 21:00:47,817 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:47,817 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 21:00:47,817 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 21:00:47,817 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 21:00:47,817 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 21:00:47,817 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36115,1676840445077' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 21:00:47,817 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 21:00:47,817 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-19 21:00:47,817 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 21:00:47,817 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:47,817 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. started... 2023-02-19 21:00:47,817 INFO [rs(jenkins-hbase4.apache.org,42621,1676840445106)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e529adc54e77727def581e798c82b03b 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-19 21:00:47,818 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,818 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,818 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:47,838 INFO [rs(jenkins-hbase4.apache.org,42621,1676840445106)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/.tmp/f1/72df8428af4b46e887da4f5f1d6c90f9 2023-02-19 21:00:47,868 INFO [rs(jenkins-hbase4.apache.org,42621,1676840445106)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/.tmp/f2/60e307f5fa6643189a713d01843642ad 2023-02-19 21:00:47,873 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/.tmp/f1/72df8428af4b46e887da4f5f1d6c90f9 as hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1/72df8428af4b46e887da4f5f1d6c90f9 2023-02-19 21:00:47,878 INFO [rs(jenkins-hbase4.apache.org,42621,1676840445106)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1/72df8428af4b46e887da4f5f1d6c90f9, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 21:00:47,879 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/.tmp/f2/60e307f5fa6643189a713d01843642ad as hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2/60e307f5fa6643189a713d01843642ad 2023-02-19 21:00:47,883 INFO [rs(jenkins-hbase4.apache.org,42621,1676840445106)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2/60e307f5fa6643189a713d01843642ad, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 21:00:47,884 INFO [rs(jenkins-hbase4.apache.org,42621,1676840445106)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for e529adc54e77727def581e798c82b03b in 67ms, sequenceid=9, compaction requested=false 2023-02-19 21:00:47,884 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e529adc54e77727def581e798c82b03b: 2023-02-19 21:00:47,884 DEBUG [rs(jenkins-hbase4.apache.org,42621,1676840445106)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:47,884 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-19 21:00:47,884 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-19 21:00:47,884 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,884 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 21:00:47,884 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42621,1676840445106' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 21:00:47,885 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,886 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:47,886 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,886 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 21:00:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:47,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42621,1676840445106' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 21:00:47,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dda09f8[Count = 0] remaining members to acquire global barrier 2023-02-19 21:00:47,888 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-19 21:00:47,888 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,889 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,889 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,890 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 21:00:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 21:00:47,890 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 21:00:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 21:00:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 21:00:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,36115,1676840445077' in zk 2023-02-19 21:00:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42621,1676840445106' in zk 2023-02-19 21:00:47,892 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 21:00:47,892 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,892 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:47,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:47,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:47,892 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 21:00:47,892 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:47,892 DEBUG [member: 'jenkins-hbase4.apache.org,36115,1676840445077' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 21:00:47,892 DEBUG [member: 'jenkins-hbase4.apache.org,42621,1676840445106' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 21:00:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:47,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:47,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42621,1676840445106': 2023-02-19 21:00:47,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42621,1676840445106' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-19 21:00:47,895 INFO [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-19 21:00:47,895 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 21:00:47,895 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 21:00:47,895 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-19 21:00:47,895 INFO [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 21:00:47,897 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,897 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 21:00:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 21:00:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,897 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:47,897 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,897 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:47,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 21:00:47,897 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:47,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:47,898 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:47,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 21:00:47,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:47,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,899 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 21:00:47,899 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 21:00:47,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,901 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,902 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:47,902 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:47,902 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 21:00:47,902 DEBUG [(jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 21:00:47,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:47,902 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:47,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 21:00:47,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 21:00:47,902 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-19 21:00:47,902 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 21:00:47,902 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:47,902 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 21:00:47,902 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 21:00:47,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:47,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:47,902 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:47,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 21:00:47,902 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 21:00:47,902 DEBUG [Listener at localhost/43483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-19 21:00:47,903 DEBUG [Listener at localhost/43483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 21:00:47,903 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:47,903 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 21:00:47,903 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 21:00:48,003 DEBUG [Listener at localhost/43483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 21:00:48,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 21:00:48,100 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/hadoop-4630728667434259823.jar 2023-02-19 21:00:48,104 INFO [Listener at localhost/43483] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676840447372 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:48,104 DEBUG [Listener at localhost/43483] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36017/user/jenkins/test-data/5d8f1102-918f-a66b-3ccf-f635f0d43128/testWithMapReduceSingleRegion/5f85708d-c662-42de-9606-c1a5b9bc14a1/data/default/testWithMapReduce 2023-02-19 21:00:48,105 INFO [Listener at localhost/43483] snapshot.RestoreSnapshotHelper(239): region to add: e529adc54e77727def581e798c82b03b 2023-02-19 21:00:48,105 INFO [Listener at localhost/43483] snapshot.RestoreSnapshotHelper(585): clone region=e529adc54e77727def581e798c82b03b as e529adc54e77727def581e798c82b03b in snapshot testWithMapReduceSingleRegion 2023-02-19 21:00:48,106 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e529adc54e77727def581e798c82b03b, NAME => 'testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36017/user/jenkins/test-data/5d8f1102-918f-a66b-3ccf-f635f0d43128/testWithMapReduceSingleRegion/5f85708d-c662-42de-9606-c1a5b9bc14a1 2023-02-19 21:00:48,115 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:48,115 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 50f7a60bf86e490989046e4823c78d69 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-19 21:00:48,117 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f08e2382262b447d90f690a8f000bd27 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-19 21:00:48,118 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e529adc54e77727def581e798c82b03b, disabling compactions & flushes 2023-02-19 21:00:48,118 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:48,118 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:48,118 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. after waiting 0 ms 2023-02-19 21:00:48,119 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:48,119 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:48,119 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e529adc54e77727def581e798c82b03b: 2023-02-19 21:00:48,119 INFO [Listener at localhost/43483] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676840447372 type: FLUSH version: 2 ttl: 0 2023-02-19 21:00:48,119 DEBUG [Listener at localhost/43483] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36017/user/jenkins/test-data/5d8f1102-918f-a66b-3ccf-f635f0d43128/testWithMapReduceSingleRegion/5f85708d-c662-42de-9606-c1a5b9bc14a1 2023-02-19 21:00:48,119 DEBUG [Listener at localhost/43483] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36017/user/jenkins/test-data/5d8f1102-918f-a66b-3ccf-f635f0d43128/testWithMapReduceSingleRegion/5f85708d-c662-42de-9606-c1a5b9bc14a1 2023-02-19 21:00:48,119 DEBUG [Listener at localhost/43483] util.CommonFSUtils(699): |-data/ 2023-02-19 21:00:48,120 DEBUG [Listener at localhost/43483] util.CommonFSUtils(699): |----default/ 2023-02-19 21:00:48,120 DEBUG [Listener at localhost/43483] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-19 21:00:48,120 DEBUG [Listener at localhost/43483] util.CommonFSUtils(699): |----------e529adc54e77727def581e798c82b03b/ 2023-02-19 21:00:48,121 DEBUG [Listener at localhost/43483] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 21:00:48,121 DEBUG [Listener at localhost/43483] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 21:00:48,121 DEBUG [Listener at localhost/43483] util.CommonFSUtils(702): |----------------testWithMapReduce=e529adc54e77727def581e798c82b03b-50f7a60bf86e490989046e4823c78d69 2023-02-19 21:00:48,121 DEBUG [Listener at localhost/43483] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 21:00:48,121 DEBUG [Listener at localhost/43483] util.CommonFSUtils(702): |----------------testWithMapReduce=e529adc54e77727def581e798c82b03b-f08e2382262b447d90f690a8f000bd27 2023-02-19 21:00:48,122 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:48,122 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:48,122 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:48,123 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:48,678 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 21:00:49,115 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/hadoop-65037752650102939.jar 2023-02-19 21:00:49,115 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:49,116 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:49,181 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/hadoop-2276951524240119098.jar 2023-02-19 21:00:49,182 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:49,182 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:49,182 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:49,183 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:49,183 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:49,183 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:49,184 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-19 21:00:49,184 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-19 21:00:49,184 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-19 21:00:49,185 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-19 21:00:49,185 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-19 21:00:49,185 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-19 21:00:49,186 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-19 21:00:49,186 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-19 21:00:49,186 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-19 21:00:49,187 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-19 21:00:49,187 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 21:00:49,188 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 21:00:49,188 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 21:00:49,188 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 21:00:49,189 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 21:00:49,269 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/hadoop-5415247799129192536.jar 2023-02-19 21:00:49,269 DEBUG [Listener at localhost/43483] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 21:00:49,279 WARN [Listener at localhost/43483] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-19 21:00:49,288 WARN [Listener at localhost/43483] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-19 21:00:49,294 INFO [Listener at localhost/43483] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 21:00:49,385 WARN [Listener at localhost/43483] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/mapreduce.cluster.local.dir/1676840449347/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-19 21:00:49,386 WARN [Listener at localhost/43483] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/mapreduce.cluster.local.dir/1676840449347/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-19 21:00:49,420 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 21:00:49,420 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 21:00:49,421 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 21:00:49,424 INFO [StoreOpener-e529adc54e77727def581e798c82b03b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e529adc54e77727def581e798c82b03b 2023-02-19 21:00:49,424 DEBUG [StoreOpener-e529adc54e77727def581e798c82b03b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/5d8f1102-918f-a66b-3ccf-f635f0d43128/testWithMapReduceSingleRegion/5f85708d-c662-42de-9606-c1a5b9bc14a1/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1 2023-02-19 21:00:49,425 INFO [StoreOpener-e529adc54e77727def581e798c82b03b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e529adc54e77727def581e798c82b03b columnFamilyName f1 2023-02-19 21:00:49,429 DEBUG [StoreOpener-e529adc54e77727def581e798c82b03b-1] regionserver.HStore(539): loaded hdfs://localhost:36017/user/jenkins/test-data/5d8f1102-918f-a66b-3ccf-f635f0d43128/testWithMapReduceSingleRegion/5f85708d-c662-42de-9606-c1a5b9bc14a1/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1/testWithMapReduce=e529adc54e77727def581e798c82b03b-50f7a60bf86e490989046e4823c78d69 2023-02-19 21:00:49,429 INFO [StoreOpener-e529adc54e77727def581e798c82b03b-1] regionserver.HStore(310): Store=e529adc54e77727def581e798c82b03b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:49,429 INFO [StoreOpener-e529adc54e77727def581e798c82b03b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e529adc54e77727def581e798c82b03b 2023-02-19 21:00:49,430 DEBUG [StoreOpener-e529adc54e77727def581e798c82b03b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36017/user/jenkins/test-data/5d8f1102-918f-a66b-3ccf-f635f0d43128/testWithMapReduceSingleRegion/5f85708d-c662-42de-9606-c1a5b9bc14a1/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2 2023-02-19 21:00:49,430 INFO [StoreOpener-e529adc54e77727def581e798c82b03b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e529adc54e77727def581e798c82b03b columnFamilyName f2 2023-02-19 21:00:49,433 DEBUG [StoreOpener-e529adc54e77727def581e798c82b03b-1] regionserver.HStore(539): loaded hdfs://localhost:36017/user/jenkins/test-data/5d8f1102-918f-a66b-3ccf-f635f0d43128/testWithMapReduceSingleRegion/5f85708d-c662-42de-9606-c1a5b9bc14a1/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2/testWithMapReduce=e529adc54e77727def581e798c82b03b-f08e2382262b447d90f690a8f000bd27 2023-02-19 21:00:49,433 INFO [StoreOpener-e529adc54e77727def581e798c82b03b-1] regionserver.HStore(310): Store=e529adc54e77727def581e798c82b03b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 21:00:49,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 21:00:49,434 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e529adc54e77727def581e798c82b03b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65722525, jitterRate=-0.020658060908317566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 21:00:49,434 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e529adc54e77727def581e798c82b03b: 2023-02-19 21:00:49,513 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e529adc54e77727def581e798c82b03b, disabling compactions & flushes 2023-02-19 21:00:49,513 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:49,513 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:49,513 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. after waiting 0 ms 2023-02-19 21:00:49,513 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:49,513 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:49,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e529adc54e77727def581e798c82b03b: 2023-02-19 21:00:50,425 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-19 21:00:50,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-19 21:00:50,428 INFO [Listener at localhost/43483] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 21:00:50,429 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 21:00:50,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-19 21:00:50,435 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840450435"}]},"ts":"1676840450435"} 2023-02-19 21:00:50,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 21:00:50,436 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-19 21:00:50,438 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-19 21:00:50,438 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e529adc54e77727def581e798c82b03b, UNASSIGN}] 2023-02-19 21:00:50,441 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e529adc54e77727def581e798c82b03b, UNASSIGN 2023-02-19 21:00:50,441 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e529adc54e77727def581e798c82b03b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:50,441 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676840450441"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676840450441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676840450441"}]},"ts":"1676840450441"} 2023-02-19 21:00:50,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure e529adc54e77727def581e798c82b03b, server=jenkins-hbase4.apache.org,42621,1676840445106}] 2023-02-19 21:00:50,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 21:00:50,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e529adc54e77727def581e798c82b03b 2023-02-19 21:00:50,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e529adc54e77727def581e798c82b03b, disabling compactions & flushes 2023-02-19 21:00:50,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:50,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:50,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. after waiting 0 ms 2023-02-19 21:00:50,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:50,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 21:00:50,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b. 2023-02-19 21:00:50,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e529adc54e77727def581e798c82b03b: 2023-02-19 21:00:50,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e529adc54e77727def581e798c82b03b 2023-02-19 21:00:50,605 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e529adc54e77727def581e798c82b03b, regionState=CLOSED 2023-02-19 21:00:50,605 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676840450604"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676840450604"}]},"ts":"1676840450604"} 2023-02-19 21:00:50,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-19 21:00:50,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure e529adc54e77727def581e798c82b03b, server=jenkins-hbase4.apache.org,42621,1676840445106 in 163 msec 2023-02-19 21:00:50,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-19 21:00:50,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e529adc54e77727def581e798c82b03b, UNASSIGN in 169 msec 2023-02-19 21:00:50,616 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676840450616"}]},"ts":"1676840450616"} 2023-02-19 21:00:50,617 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-19 21:00:50,619 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-19 21:00:50,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 191 msec 2023-02-19 21:00:50,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 21:00:50,739 INFO [Listener at localhost/43483] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-19 21:00:50,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-19 21:00:50,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-19 21:00:50,742 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 21:00:50,742 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 21:00:50,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 21:00:50,745 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b 2023-02-19 21:00:50,746 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1, FileablePath, hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2, FileablePath, hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/recovered.edits] 2023-02-19 21:00:50,749 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1/50f7a60bf86e490989046e4823c78d69 to hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/archive/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1/50f7a60bf86e490989046e4823c78d69 2023-02-19 21:00:50,750 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1/72df8428af4b46e887da4f5f1d6c90f9 to hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/archive/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f1/72df8428af4b46e887da4f5f1d6c90f9 2023-02-19 21:00:50,752 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2/60e307f5fa6643189a713d01843642ad to hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/archive/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2/60e307f5fa6643189a713d01843642ad 2023-02-19 21:00:50,754 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2/f08e2382262b447d90f690a8f000bd27 to hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/archive/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/f2/f08e2382262b447d90f690a8f000bd27 2023-02-19 21:00:50,756 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/recovered.edits/12.seqid to hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/archive/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b/recovered.edits/12.seqid 2023-02-19 21:00:50,757 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/.tmp/data/default/testWithMapReduce/e529adc54e77727def581e798c82b03b 2023-02-19 21:00:50,757 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 21:00:50,758 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 21:00:50,760 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-19 21:00:50,765 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-19 21:00:50,766 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 21:00:50,766 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-19 21:00:50,766 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676840450766"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:50,768 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-19 21:00:50,768 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e529adc54e77727def581e798c82b03b, NAME => 'testWithMapReduce,,1676840446134.e529adc54e77727def581e798c82b03b.', STARTKEY => '', ENDKEY => ''}] 2023-02-19 21:00:50,768 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-19 21:00:50,768 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676840450768"}]},"ts":"9223372036854775807"} 2023-02-19 21:00:50,769 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-19 21:00:50,771 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 21:00:50,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 32 msec 2023-02-19 21:00:50,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40373] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 21:00:50,844 INFO [Listener at localhost/43483] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-19 21:00:50,844 INFO [Listener at localhost/43483] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 21:00:50,844 INFO [Listener at localhost/43483] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 21:00:50,844 DEBUG [Listener at localhost/43483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x151c8f86 to 127.0.0.1:56339 2023-02-19 21:00:50,844 DEBUG [Listener at localhost/43483] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:50,845 DEBUG [Listener at localhost/43483] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 21:00:50,845 DEBUG [Listener at localhost/43483] util.JVMClusterUtil(257): Found active master hash=1296736964, stopped=false 2023-02-19 21:00:50,845 INFO [Listener at localhost/43483] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40373,1676840445023 2023-02-19 21:00:50,846 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:50,846 INFO [Listener at localhost/43483] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 21:00:50,846 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:50,846 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 21:00:50,848 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:50,848 DEBUG [Listener at localhost/43483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78af419f to 127.0.0.1:56339 2023-02-19 21:00:50,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:50,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:50,848 DEBUG [Listener at localhost/43483] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:50,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 21:00:50,848 INFO [Listener at localhost/43483] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36115,1676840445077' ***** 2023-02-19 21:00:50,848 INFO [Listener at localhost/43483] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:50,848 INFO [Listener at localhost/43483] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42621,1676840445106' ***** 2023-02-19 21:00:50,848 INFO [Listener at localhost/43483] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 21:00:50,848 INFO [RS:0;jenkins-hbase4:36115] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:50,849 INFO [RS:1;jenkins-hbase4:42621] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 21:00:50,849 INFO [RS:0;jenkins-hbase4:36115] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:50,849 INFO [RS:1;jenkins-hbase4:42621] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 21:00:50,849 INFO [RS:0;jenkins-hbase4:36115] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:50,849 INFO [RS:1;jenkins-hbase4:42621] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 21:00:50,849 INFO [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:50,849 INFO [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(3304): Received CLOSE for 2dbb4cc83834627208302bc9079f0aa0 2023-02-19 21:00:50,849 DEBUG [RS:0;jenkins-hbase4:36115] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71f62b76 to 127.0.0.1:56339 2023-02-19 21:00:50,849 INFO [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:50,849 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:50,849 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 21:00:50,849 DEBUG [RS:1;jenkins-hbase4:42621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42b174f4 to 127.0.0.1:56339 2023-02-19 21:00:50,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2dbb4cc83834627208302bc9079f0aa0, disabling compactions & flushes 2023-02-19 21:00:50,849 DEBUG [RS:0;jenkins-hbase4:36115] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:50,852 INFO [RS:0;jenkins-hbase4:36115] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:50,852 INFO [RS:0;jenkins-hbase4:36115] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:50,852 INFO [RS:0;jenkins-hbase4:36115] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:50,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. 2023-02-19 21:00:50,851 DEBUG [RS:1;jenkins-hbase4:42621] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:50,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. 2023-02-19 21:00:50,852 INFO [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 21:00:50,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. after waiting 0 ms 2023-02-19 21:00:50,852 INFO [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 21:00:50,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. 2023-02-19 21:00:50,852 DEBUG [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(1479): Online Regions={2dbb4cc83834627208302bc9079f0aa0=hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0.} 2023-02-19 21:00:50,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 2dbb4cc83834627208302bc9079f0aa0 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 21:00:50,852 DEBUG [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(1505): Waiting on 2dbb4cc83834627208302bc9079f0aa0 2023-02-19 21:00:50,852 INFO [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 21:00:50,852 DEBUG [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-19 21:00:50,852 DEBUG [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 21:00:50,853 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 21:00:50,853 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 21:00:50,853 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 21:00:50,853 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 21:00:50,853 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 21:00:50,853 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-19 21:00:50,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0/.tmp/info/5aaae6d65c4b40489e9f9b89bd8d7697 2023-02-19 21:00:50,865 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/.tmp/info/9b62b9b8456a43b88e92b5ba0124e02d 2023-02-19 21:00:50,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0/.tmp/info/5aaae6d65c4b40489e9f9b89bd8d7697 as hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0/info/5aaae6d65c4b40489e9f9b89bd8d7697 2023-02-19 21:00:50,869 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9b62b9b8456a43b88e92b5ba0124e02d 2023-02-19 21:00:50,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0/info/5aaae6d65c4b40489e9f9b89bd8d7697, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 21:00:50,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2dbb4cc83834627208302bc9079f0aa0 in 21ms, sequenceid=6, compaction requested=false 2023-02-19 21:00:50,876 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/.tmp/rep_barrier/6dab9eca563e40299544aed4e3222384 2023-02-19 21:00:50,877 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:50,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/namespace/2dbb4cc83834627208302bc9079f0aa0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 21:00:50,880 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:50,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. 2023-02-19 21:00:50,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2dbb4cc83834627208302bc9079f0aa0: 2023-02-19 21:00:50,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676840445621.2dbb4cc83834627208302bc9079f0aa0. 2023-02-19 21:00:50,883 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6dab9eca563e40299544aed4e3222384 2023-02-19 21:00:50,889 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/.tmp/table/20ab39df9e924ef6a330ee927b700f0e 2023-02-19 21:00:50,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20ab39df9e924ef6a330ee927b700f0e 2023-02-19 21:00:50,894 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/.tmp/info/9b62b9b8456a43b88e92b5ba0124e02d as hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/info/9b62b9b8456a43b88e92b5ba0124e02d 2023-02-19 21:00:50,897 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9b62b9b8456a43b88e92b5ba0124e02d 2023-02-19 21:00:50,897 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/info/9b62b9b8456a43b88e92b5ba0124e02d, entries=12, sequenceid=21, filesize=6.2 K 2023-02-19 21:00:50,898 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/.tmp/rep_barrier/6dab9eca563e40299544aed4e3222384 as hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/rep_barrier/6dab9eca563e40299544aed4e3222384 2023-02-19 21:00:50,902 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6dab9eca563e40299544aed4e3222384 2023-02-19 21:00:50,902 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/rep_barrier/6dab9eca563e40299544aed4e3222384, entries=1, sequenceid=21, filesize=5.0 K 2023-02-19 21:00:50,902 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/.tmp/table/20ab39df9e924ef6a330ee927b700f0e as hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/table/20ab39df9e924ef6a330ee927b700f0e 2023-02-19 21:00:50,906 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20ab39df9e924ef6a330ee927b700f0e 2023-02-19 21:00:50,906 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/table/20ab39df9e924ef6a330ee927b700f0e, entries=4, sequenceid=21, filesize=5.0 K 2023-02-19 21:00:50,907 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=21, compaction requested=false 2023-02-19 21:00:50,912 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-19 21:00:50,912 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 21:00:50,913 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:50,913 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 21:00:50,913 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 21:00:51,052 INFO [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42621,1676840445106; all regions closed. 2023-02-19 21:00:51,053 INFO [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36115,1676840445077; all regions closed. 2023-02-19 21:00:51,057 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/WALs/jenkins-hbase4.apache.org,36115,1676840445077/jenkins-hbase4.apache.org%2C36115%2C1676840445077.meta.1676840445573.meta not finished, retry = 0 2023-02-19 21:00:51,057 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/WALs/jenkins-hbase4.apache.org,42621,1676840445106/jenkins-hbase4.apache.org%2C42621%2C1676840445106.1676840445988 not finished, retry = 0 2023-02-19 21:00:51,159 DEBUG [RS:1;jenkins-hbase4:42621] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/oldWALs 2023-02-19 21:00:51,159 DEBUG [RS:0;jenkins-hbase4:36115] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/oldWALs 2023-02-19 21:00:51,160 INFO [RS:1;jenkins-hbase4:42621] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42621%2C1676840445106:(num 1676840445988) 2023-02-19 21:00:51,160 INFO [RS:0;jenkins-hbase4:36115] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36115%2C1676840445077.meta:.meta(num 1676840445573) 2023-02-19 21:00:51,160 DEBUG [RS:1;jenkins-hbase4:42621] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:51,160 INFO [RS:1;jenkins-hbase4:42621] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:51,160 INFO [RS:1;jenkins-hbase4:42621] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:51,160 INFO [RS:1;jenkins-hbase4:42621] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 21:00:51,160 INFO [RS:1;jenkins-hbase4:42621] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 21:00:51,160 INFO [RS:1;jenkins-hbase4:42621] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 21:00:51,160 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:51,162 INFO [RS:1;jenkins-hbase4:42621] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42621 2023-02-19 21:00:51,164 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:51,164 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:51,164 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:51,164 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42621,1676840445106 2023-02-19 21:00:51,164 ERROR [Listener at localhost/43483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f1c4ff0 rejected from java.util.concurrent.ThreadPoolExecutor@2b23cecb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:51,164 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:51,164 ERROR [Listener at localhost/43483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12abc3c9 rejected from java.util.concurrent.ThreadPoolExecutor@2b23cecb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:51,166 DEBUG [RS:0;jenkins-hbase4:36115] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/oldWALs 2023-02-19 21:00:51,166 INFO [RS:0;jenkins-hbase4:36115] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36115%2C1676840445077:(num 1676840446401) 2023-02-19 21:00:51,166 DEBUG [RS:0;jenkins-hbase4:36115] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:51,166 INFO [RS:0;jenkins-hbase4:36115] regionserver.LeaseManager(133): Closed leases 2023-02-19 21:00:51,166 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42621,1676840445106] 2023-02-19 21:00:51,166 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42621,1676840445106; numProcessing=1 2023-02-19 21:00:51,166 INFO [RS:0;jenkins-hbase4:36115] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 21:00:51,166 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:51,169 INFO [RS:0;jenkins-hbase4:36115] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36115 2023-02-19 21:00:51,170 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42621,1676840445106 already deleted, retry=false 2023-02-19 21:00:51,170 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42621,1676840445106 expired; onlineServers=1 2023-02-19 21:00:51,171 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36115,1676840445077 2023-02-19 21:00:51,171 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 21:00:51,171 ERROR [Listener at localhost/43483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26e6b954 rejected from java.util.concurrent.ThreadPoolExecutor@22d92950[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:51,172 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36115,1676840445077] 2023-02-19 21:00:51,172 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36115,1676840445077; numProcessing=2 2023-02-19 21:00:51,175 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36115,1676840445077 already deleted, retry=false 2023-02-19 21:00:51,175 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36115,1676840445077 expired; onlineServers=0 2023-02-19 21:00:51,175 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40373,1676840445023' ***** 2023-02-19 21:00:51,175 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 21:00:51,175 DEBUG [M:0;jenkins-hbase4:40373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49753fb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 21:00:51,176 INFO [M:0;jenkins-hbase4:40373] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40373,1676840445023 2023-02-19 21:00:51,176 INFO [M:0;jenkins-hbase4:40373] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40373,1676840445023; all regions closed. 2023-02-19 21:00:51,176 DEBUG [M:0;jenkins-hbase4:40373] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 21:00:51,176 DEBUG [M:0;jenkins-hbase4:40373] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 21:00:51,176 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 21:00:51,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840445233] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676840445233,5,FailOnTimeoutGroup] 2023-02-19 21:00:51,176 DEBUG [M:0;jenkins-hbase4:40373] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 21:00:51,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840445232] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676840445232,5,FailOnTimeoutGroup] 2023-02-19 21:00:51,177 INFO [M:0;jenkins-hbase4:40373] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 21:00:51,178 INFO [M:0;jenkins-hbase4:40373] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 21:00:51,178 INFO [M:0;jenkins-hbase4:40373] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 21:00:51,178 DEBUG [M:0;jenkins-hbase4:40373] master.HMaster(1512): Stopping service threads 2023-02-19 21:00:51,178 INFO [M:0;jenkins-hbase4:40373] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 21:00:51,179 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 21:00:51,179 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 21:00:51,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 21:00:51,180 ERROR [M:0;jenkins-hbase4:40373] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 21:00:51,180 INFO [M:0;jenkins-hbase4:40373] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 21:00:51,180 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 21:00:51,181 DEBUG [M:0;jenkins-hbase4:40373] zookeeper.ZKUtil(398): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 21:00:51,181 WARN [M:0;jenkins-hbase4:40373] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 21:00:51,181 INFO [M:0;jenkins-hbase4:40373] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 21:00:51,181 INFO [M:0;jenkins-hbase4:40373] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 21:00:51,182 DEBUG [M:0;jenkins-hbase4:40373] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 21:00:51,182 INFO [M:0;jenkins-hbase4:40373] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:51,182 DEBUG [M:0;jenkins-hbase4:40373] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:51,182 DEBUG [M:0;jenkins-hbase4:40373] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 21:00:51,182 DEBUG [M:0;jenkins-hbase4:40373] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:51,182 INFO [M:0;jenkins-hbase4:40373] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.66 KB heapSize=65.63 KB 2023-02-19 21:00:51,194 INFO [M:0;jenkins-hbase4:40373] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.66 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cd9c86d6ad8943a6af2af813604aa50d 2023-02-19 21:00:51,198 DEBUG [M:0;jenkins-hbase4:40373] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cd9c86d6ad8943a6af2af813604aa50d as hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cd9c86d6ad8943a6af2af813604aa50d 2023-02-19 21:00:51,202 INFO [M:0;jenkins-hbase4:40373] regionserver.HStore(1080): Added hdfs://localhost:36017/user/jenkins/test-data/41a79a98-13b7-08e2-b5bd-54baa064d5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cd9c86d6ad8943a6af2af813604aa50d, entries=17, sequenceid=132, filesize=8.6 K 2023-02-19 21:00:51,203 INFO [M:0;jenkins-hbase4:40373] regionserver.HRegion(2947): Finished flush of dataSize ~54.66 KB/55975, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=132, compaction requested=false 2023-02-19 21:00:51,204 INFO [M:0;jenkins-hbase4:40373] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 21:00:51,204 DEBUG [M:0;jenkins-hbase4:40373] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 21:00:51,206 INFO [M:0;jenkins-hbase4:40373] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 21:00:51,206 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 21:00:51,206 INFO [M:0;jenkins-hbase4:40373] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40373 2023-02-19 21:00:51,207 DEBUG [M:0;jenkins-hbase4:40373] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40373,1676840445023 already deleted, retry=false 2023-02-19 21:00:51,349 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:51,349 INFO [M:0;jenkins-hbase4:40373] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40373,1676840445023; zookeeper connection closed. 2023-02-19 21:00:51,349 ERROR [Listener at localhost/43483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@283711c5 rejected from java.util.concurrent.ThreadPoolExecutor@2c08801b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:51,350 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): master:40373-0x1006e628e0c0000, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:51,350 ERROR [Listener at localhost/43483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48001e07 rejected from java.util.concurrent.ThreadPoolExecutor@2c08801b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:51,449 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 21:00:51,449 INFO [RS:0;jenkins-hbase4:36115] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36115,1676840445077; zookeeper connection closed. 2023-02-19 21:00:51,449 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:51,450 ERROR [Listener at localhost/43483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@45c9ddf6 rejected from java.util.concurrent.ThreadPoolExecutor@22d92950[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:51,450 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:36115-0x1006e628e0c0001, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:51,450 ERROR [Listener at localhost/43483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3d8ec035 rejected from java.util.concurrent.ThreadPoolExecutor@22d92950[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:51,450 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@50b3fb0b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@50b3fb0b 2023-02-19 21:00:51,550 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:51,550 INFO [RS:1;jenkins-hbase4:42621] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42621,1676840445106; zookeeper connection closed. 2023-02-19 21:00:51,550 ERROR [Listener at localhost/43483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a65b51e rejected from java.util.concurrent.ThreadPoolExecutor@2b23cecb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:51,550 DEBUG [Listener at localhost/43483-EventThread] zookeeper.ZKWatcher(600): regionserver:42621-0x1006e628e0c0002, quorum=127.0.0.1:56339, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 21:00:51,550 ERROR [Listener at localhost/43483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@42f79507 rejected from java.util.concurrent.ThreadPoolExecutor@2b23cecb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 21:00:51,550 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@77d70119] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@77d70119 2023-02-19 21:00:51,550 INFO [Listener at localhost/43483] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 21:00:51,551 WARN [Listener at localhost/43483] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:51,555 INFO [Listener at localhost/43483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:51,560 WARN [BP-34634596-172.31.14.131-1676840444432 heartbeating to localhost/127.0.0.1:36017] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:51,560 WARN [BP-34634596-172.31.14.131-1676840444432 heartbeating to localhost/127.0.0.1:36017] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-34634596-172.31.14.131-1676840444432 (Datanode Uuid 608af996-f4de-4668-90bb-db920c42fddb) service to localhost/127.0.0.1:36017 2023-02-19 21:00:51,561 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/cluster_4e74e50e-0cd4-ccae-22f9-262a93ec5e29/dfs/data/data4/current/BP-34634596-172.31.14.131-1676840444432] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:51,563 WARN [Listener at localhost/43483] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 21:00:51,563 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/cluster_4e74e50e-0cd4-ccae-22f9-262a93ec5e29/dfs/data/data3/current/BP-34634596-172.31.14.131-1676840444432] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:51,568 INFO [Listener at localhost/43483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:51,576 WARN [BP-34634596-172.31.14.131-1676840444432 heartbeating to localhost/127.0.0.1:36017] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 21:00:51,576 WARN [BP-34634596-172.31.14.131-1676840444432 heartbeating to localhost/127.0.0.1:36017] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-34634596-172.31.14.131-1676840444432 (Datanode Uuid 01ea87ad-b362-4e93-aeb2-1b1ff522b4bd) service to localhost/127.0.0.1:36017 2023-02-19 21:00:51,576 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/cluster_4e74e50e-0cd4-ccae-22f9-262a93ec5e29/dfs/data/data1/current/BP-34634596-172.31.14.131-1676840444432] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:51,577 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da419a2f-90b8-8443-2ccd-f9a05d6c0702/cluster_4e74e50e-0cd4-ccae-22f9-262a93ec5e29/dfs/data/data2/current/BP-34634596-172.31.14.131-1676840444432] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 21:00:51,589 INFO [Listener at localhost/43483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 21:00:51,703 INFO [Listener at localhost/43483] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 21:00:51,727 INFO [Listener at localhost/43483] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 21:00:51,740 INFO [Listener at localhost/43483] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=289 (was 270) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:36017 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36017 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:36017 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:36017 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,40373,1676840445023)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43483 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:36017 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:36017 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (281448501) connection to localhost/127.0.0.1:36017 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=599 (was 571) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 287) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 170), AvailableMemoryMB=9891 (was 8838) - AvailableMemoryMB LEAK? -