2023-02-11 22:03:03,919 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-11 22:03:03,963 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=220, ProcessCount=166, AvailableMemoryMB=11009 2023-02-11 22:03:04,244 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7 2023-02-11 22:03:04,252 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 22:03:04,252 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/cluster_19036758-f5d2-f16e-2cdf-2f93116bdee6, deleteOnExit=true 2023-02-11 22:03:04,253 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 22:03:04,253 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/test.cache.data in system properties and HBase conf 2023-02-11 22:03:04,254 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 22:03:04,254 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/hadoop.log.dir in system properties and HBase conf 2023-02-11 22:03:04,255 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 22:03:04,255 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 22:03:04,255 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 22:03:04,348 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-11 22:03:04,721 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 22:03:04,725 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:04,725 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:04,726 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 22:03:04,726 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:04,726 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 22:03:04,727 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 22:03:04,727 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:04,727 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:04,727 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 22:03:04,728 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/nfs.dump.dir in system properties and HBase conf 2023-02-11 22:03:04,728 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/java.io.tmpdir in system properties and HBase conf 2023-02-11 22:03:04,728 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:04,728 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 22:03:04,729 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 22:03:05,242 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:05,246 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:05,503 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-11 22:03:05,694 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-11 22:03:05,706 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:05,738 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:05,769 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/java.io.tmpdir/Jetty_localhost_43339_hdfs____.wum2qk/webapp 2023-02-11 22:03:05,909 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43339 2023-02-11 22:03:05,923 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:05,923 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:06,474 WARN [Listener at localhost/38825] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:06,570 WARN [Listener at localhost/38825] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:06,590 WARN [Listener at localhost/38825] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:06,595 INFO [Listener at localhost/38825] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:06,600 INFO [Listener at localhost/38825] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/java.io.tmpdir/Jetty_localhost_43823_datanode____dxc51d/webapp 2023-02-11 22:03:06,713 INFO [Listener at localhost/38825] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43823 2023-02-11 22:03:07,119 WARN [Listener at localhost/33951] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:07,172 WARN [Listener at localhost/33951] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:07,176 WARN [Listener at localhost/33951] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:07,177 INFO [Listener at localhost/33951] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:07,183 INFO [Listener at localhost/33951] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/java.io.tmpdir/Jetty_localhost_40917_datanode____.hw2zqu/webapp 2023-02-11 22:03:07,318 INFO [Listener at localhost/33951] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40917 2023-02-11 22:03:07,328 WARN [Listener at localhost/34175] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:07,620 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfe8cf5af1ed4e6bc: Processing first storage report for DS-89900f8e-96f4-459e-a879-bcafd4fa047f from datanode 2c0d406b-d90c-4cbb-badf-8f34cc0e16da 2023-02-11 22:03:07,622 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfe8cf5af1ed4e6bc: from storage DS-89900f8e-96f4-459e-a879-bcafd4fa047f node DatanodeRegistration(127.0.0.1:39245, datanodeUuid=2c0d406b-d90c-4cbb-badf-8f34cc0e16da, infoPort=35225, infoSecurePort=0, ipcPort=34175, storageInfo=lv=-57;cid=testClusterID;nsid=1872486227;c=1676152985310), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-11 22:03:07,622 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x32974e57054fd5fe: Processing first storage report for DS-08face37-bd45-425b-bc4e-51d0b902cc4b from datanode 34eb48e4-7c43-4a00-9b11-832616aa6c94 2023-02-11 22:03:07,622 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x32974e57054fd5fe: from storage DS-08face37-bd45-425b-bc4e-51d0b902cc4b node DatanodeRegistration(127.0.0.1:36967, datanodeUuid=34eb48e4-7c43-4a00-9b11-832616aa6c94, infoPort=37977, infoSecurePort=0, ipcPort=33951, storageInfo=lv=-57;cid=testClusterID;nsid=1872486227;c=1676152985310), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-11 22:03:07,623 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfe8cf5af1ed4e6bc: Processing first storage report for DS-b9112320-d620-4527-84cd-528ccc9484b2 from datanode 2c0d406b-d90c-4cbb-badf-8f34cc0e16da 2023-02-11 22:03:07,623 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfe8cf5af1ed4e6bc: from storage DS-b9112320-d620-4527-84cd-528ccc9484b2 node DatanodeRegistration(127.0.0.1:39245, datanodeUuid=2c0d406b-d90c-4cbb-badf-8f34cc0e16da, infoPort=35225, infoSecurePort=0, ipcPort=34175, storageInfo=lv=-57;cid=testClusterID;nsid=1872486227;c=1676152985310), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:07,623 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x32974e57054fd5fe: Processing first storage report for DS-d9bb0bfe-0d51-4cb2-a6bf-aaf321ec1f11 from datanode 34eb48e4-7c43-4a00-9b11-832616aa6c94 2023-02-11 22:03:07,623 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x32974e57054fd5fe: from storage DS-d9bb0bfe-0d51-4cb2-a6bf-aaf321ec1f11 node DatanodeRegistration(127.0.0.1:36967, datanodeUuid=34eb48e4-7c43-4a00-9b11-832616aa6c94, infoPort=37977, infoSecurePort=0, ipcPort=33951, storageInfo=lv=-57;cid=testClusterID;nsid=1872486227;c=1676152985310), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:07,730 DEBUG [Listener at localhost/34175] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7 2023-02-11 22:03:07,813 INFO [Listener at localhost/34175] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/cluster_19036758-f5d2-f16e-2cdf-2f93116bdee6/zookeeper_0, clientPort=58719, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/cluster_19036758-f5d2-f16e-2cdf-2f93116bdee6/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/cluster_19036758-f5d2-f16e-2cdf-2f93116bdee6/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 22:03:07,829 INFO [Listener at localhost/34175] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58719 2023-02-11 22:03:07,840 INFO [Listener at localhost/34175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:07,843 INFO [Listener at localhost/34175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:08,526 INFO [Listener at localhost/34175] util.FSUtils(479): Created version file at hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a with version=8 2023-02-11 22:03:08,527 INFO [Listener at localhost/34175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:08,529 INFO [Listener at localhost/34175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:08,532 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/hbase-staging 2023-02-11 22:03:08,870 INFO [Listener at localhost/34175] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-11 22:03:09,335 INFO [Listener at localhost/34175] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:09,368 INFO [Listener at localhost/34175] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:09,368 INFO [Listener at localhost/34175] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:09,369 INFO [Listener at localhost/34175] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:09,369 INFO [Listener at localhost/34175] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:09,369 INFO [Listener at localhost/34175] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:09,565 INFO [Listener at localhost/34175] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:09,635 DEBUG [Listener at localhost/34175] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-11 22:03:09,729 INFO [Listener at localhost/34175] ipc.NettyRpcServer(120): Bind to /172.31.2.10:46805 2023-02-11 22:03:09,739 INFO [Listener at localhost/34175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:09,741 INFO [Listener at localhost/34175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:09,762 INFO [Listener at localhost/34175] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46805 connecting to ZooKeeper ensemble=127.0.0.1:58719 2023-02-11 22:03:09,805 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:468050x0, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:09,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:46805-0x1004569c07f0000 connected 2023-02-11 22:03:09,833 DEBUG [Listener at localhost/34175] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:09,834 DEBUG [Listener at localhost/34175] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:09,837 DEBUG [Listener at localhost/34175] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:09,845 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46805 2023-02-11 22:03:09,846 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46805 2023-02-11 22:03:09,846 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46805 2023-02-11 22:03:09,848 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46805 2023-02-11 22:03:09,849 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46805 2023-02-11 22:03:09,856 INFO [Listener at localhost/34175] master.HMaster(439): hbase.rootdir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a, hbase.cluster.distributed=false 2023-02-11 22:03:09,926 INFO [Listener at localhost/34175] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:09,926 INFO [Listener at localhost/34175] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:09,927 INFO [Listener at localhost/34175] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:09,927 INFO [Listener at localhost/34175] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:09,927 INFO [Listener at localhost/34175] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:09,927 INFO [Listener at localhost/34175] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:09,932 INFO [Listener at localhost/34175] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:09,935 INFO [Listener at localhost/34175] ipc.NettyRpcServer(120): Bind to /172.31.2.10:34009 2023-02-11 22:03:09,938 INFO [Listener at localhost/34175] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:09,945 DEBUG [Listener at localhost/34175] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:09,946 INFO [Listener at localhost/34175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:09,948 INFO [Listener at localhost/34175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:09,949 INFO [Listener at localhost/34175] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34009 connecting to ZooKeeper ensemble=127.0.0.1:58719 2023-02-11 22:03:09,953 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:340090x0, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:09,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34009-0x1004569c07f0001 connected 2023-02-11 22:03:09,954 DEBUG [Listener at localhost/34175] zookeeper.ZKUtil(164): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:09,956 DEBUG [Listener at localhost/34175] zookeeper.ZKUtil(164): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:09,956 DEBUG [Listener at localhost/34175] zookeeper.ZKUtil(164): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:09,957 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34009 2023-02-11 22:03:09,958 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34009 2023-02-11 22:03:09,959 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34009 2023-02-11 22:03:09,960 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34009 2023-02-11 22:03:09,960 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34009 2023-02-11 22:03:09,973 INFO [Listener at localhost/34175] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:09,973 INFO [Listener at localhost/34175] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:09,973 INFO [Listener at localhost/34175] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:09,974 INFO [Listener at localhost/34175] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:09,974 INFO [Listener at localhost/34175] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:09,974 INFO [Listener at localhost/34175] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:09,974 INFO [Listener at localhost/34175] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:09,976 INFO [Listener at localhost/34175] ipc.NettyRpcServer(120): Bind to /172.31.2.10:42223 2023-02-11 22:03:09,976 INFO [Listener at localhost/34175] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:09,979 DEBUG [Listener at localhost/34175] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:09,979 INFO [Listener at localhost/34175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:09,981 INFO [Listener at localhost/34175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:09,984 INFO [Listener at localhost/34175] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42223 connecting to ZooKeeper ensemble=127.0.0.1:58719 2023-02-11 22:03:09,989 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:422230x0, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:09,990 DEBUG [Listener at localhost/34175] zookeeper.ZKUtil(164): regionserver:422230x0, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:09,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42223-0x1004569c07f0002 connected 2023-02-11 22:03:09,991 DEBUG [Listener at localhost/34175] zookeeper.ZKUtil(164): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:09,992 DEBUG [Listener at localhost/34175] zookeeper.ZKUtil(164): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:09,995 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42223 2023-02-11 22:03:09,995 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42223 2023-02-11 22:03:09,999 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42223 2023-02-11 22:03:09,999 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42223 2023-02-11 22:03:09,999 DEBUG [Listener at localhost/34175] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42223 2023-02-11 22:03:10,001 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,46805,1676152988691 2023-02-11 22:03:10,012 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:10,014 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,46805,1676152988691 2023-02-11 22:03:10,033 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:10,033 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:10,033 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:10,033 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:10,035 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:10,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:10,036 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,46805,1676152988691 from backup master directory 2023-02-11 22:03:10,040 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,46805,1676152988691 2023-02-11 22:03:10,040 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:10,040 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:10,040 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,46805,1676152988691 2023-02-11 22:03:10,044 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-11 22:03:10,045 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-11 22:03:10,134 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/hbase.id with ID: aa9f0485-7fd3-48af-94f7-c51f2f0e654a 2023-02-11 22:03:10,173 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:10,189 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:10,247 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2cbbe167 to 127.0.0.1:58719 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:10,287 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3822562c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:10,310 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:10,313 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 22:03:10,332 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-11 22:03:10,332 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-11 22:03:10,334 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-11 22:03:10,338 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-11 22:03:10,339 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:10,374 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/data/master/store-tmp 2023-02-11 22:03:10,406 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:10,406 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:10,407 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:10,407 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:10,407 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:10,407 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:10,407 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:10,408 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676152990406Disabling compacts and flushes for region at 1676152990406Disabling writes for close at 1676152990407 (+1 ms)Writing region close event to WAL at 1676152990407Closed at 1676152990407 2023-02-11 22:03:10,409 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/WALs/jenkins-hbase9.apache.org,46805,1676152988691 2023-02-11 22:03:10,432 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C46805%2C1676152988691, suffix=, logDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/WALs/jenkins-hbase9.apache.org,46805,1676152988691, archiveDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/oldWALs, maxLogs=10 2023-02-11 22:03:10,491 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36967,DS-08face37-bd45-425b-bc4e-51d0b902cc4b,DISK] 2023-02-11 22:03:10,491 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39245,DS-89900f8e-96f4-459e-a879-bcafd4fa047f,DISK] 2023-02-11 22:03:10,499 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-11 22:03:10,561 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/WALs/jenkins-hbase9.apache.org,46805,1676152988691/jenkins-hbase9.apache.org%2C46805%2C1676152988691.1676152990442 2023-02-11 22:03:10,561 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39245,DS-89900f8e-96f4-459e-a879-bcafd4fa047f,DISK], DatanodeInfoWithStorage[127.0.0.1:36967,DS-08face37-bd45-425b-bc4e-51d0b902cc4b,DISK]] 2023-02-11 22:03:10,562 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:10,563 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:10,567 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:10,568 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:10,632 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:10,639 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 22:03:10,672 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 22:03:10,684 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:10,691 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:10,692 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:10,709 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:10,713 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:10,715 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74319154, jitterRate=0.10744169354438782}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:10,715 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676152990600Initializing all the Stores at 1676152990602 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152990603 (+1 ms)Cleaning up temporary data from old regions at 1676152990698 (+95 ms)Cleaning up detritus from prior splits at 1676152990699 (+1 ms)Region opened successfully at 1676152990715 (+16 ms) 2023-02-11 22:03:10,716 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 22:03:10,738 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 22:03:10,738 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 22:03:10,741 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 22:03:10,743 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-11 22:03:10,778 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-02-11 22:03:10,778 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 22:03:10,814 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 22:03:10,820 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 22:03:10,844 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 22:03:10,849 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 22:03:10,850 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 22:03:10,857 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 22:03:10,861 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 22:03:10,863 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:10,865 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 22:03:10,865 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 22:03:10,877 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 22:03:10,883 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:10,883 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:10,883 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:10,883 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:10,883 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,46805,1676152988691, sessionid=0x1004569c07f0000, setting cluster-up flag (Was=false) 2023-02-11 22:03:10,900 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:10,904 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 22:03:10,906 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,46805,1676152988691 2023-02-11 22:03:10,913 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:10,919 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 22:03:10,920 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,46805,1676152988691 2023-02-11 22:03:10,923 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.hbase-snapshot/.tmp 2023-02-11 22:03:11,007 INFO [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(952): ClusterId : aa9f0485-7fd3-48af-94f7-c51f2f0e654a 2023-02-11 22:03:11,007 INFO [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(952): ClusterId : aa9f0485-7fd3-48af-94f7-c51f2f0e654a 2023-02-11 22:03:11,015 DEBUG [RS:0;jenkins-hbase9:34009] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:11,015 DEBUG [RS:1;jenkins-hbase9:42223] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:11,025 DEBUG [RS:1;jenkins-hbase9:42223] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:11,025 DEBUG [RS:1;jenkins-hbase9:42223] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:11,025 DEBUG [RS:0;jenkins-hbase9:34009] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:11,026 DEBUG [RS:0;jenkins-hbase9:34009] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:11,035 DEBUG [RS:1;jenkins-hbase9:42223] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:11,035 DEBUG [RS:0;jenkins-hbase9:34009] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:11,037 DEBUG [RS:1;jenkins-hbase9:42223] zookeeper.ReadOnlyZKClient(139): Connect 0x7764377c to 127.0.0.1:58719 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:11,037 DEBUG [RS:0;jenkins-hbase9:34009] zookeeper.ReadOnlyZKClient(139): Connect 0x16d5abf1 to 127.0.0.1:58719 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:11,054 DEBUG [RS:0;jenkins-hbase9:34009] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fec9fee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:11,055 DEBUG [RS:0;jenkins-hbase9:34009] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@daf19ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:11,057 DEBUG [RS:1;jenkins-hbase9:42223] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d9676f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:11,057 DEBUG [RS:1;jenkins-hbase9:42223] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bf0655b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:11,078 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:11,080 DEBUG [RS:0;jenkins-hbase9:34009] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:34009 2023-02-11 22:03:11,084 DEBUG [RS:1;jenkins-hbase9:42223] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:42223 2023-02-11 22:03:11,086 INFO [RS:0;jenkins-hbase9:34009] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:11,086 INFO [RS:1;jenkins-hbase9:42223] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:11,087 INFO [RS:1;jenkins-hbase9:42223] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:11,087 INFO [RS:0;jenkins-hbase9:34009] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:11,087 DEBUG [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:11,087 DEBUG [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:11,090 INFO [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,46805,1676152988691 with isa=jenkins-hbase9.apache.org/172.31.2.10:34009, startcode=1676152989925 2023-02-11 22:03:11,090 INFO [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,46805,1676152988691 with isa=jenkins-hbase9.apache.org/172.31.2.10:42223, startcode=1676152989972 2023-02-11 22:03:11,093 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:11,093 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:11,094 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:11,094 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:11,094 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-11 22:03:11,094 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,094 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:11,094 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,106 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676153021106 2023-02-11 22:03:11,109 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 22:03:11,109 DEBUG [RS:0;jenkins-hbase9:34009] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:11,109 DEBUG [RS:1;jenkins-hbase9:42223] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:11,114 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:11,115 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 22:03:11,121 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:11,125 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 22:03:11,140 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 22:03:11,142 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 22:03:11,143 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 22:03:11,143 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 22:03:11,147 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,154 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 22:03:11,157 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 22:03:11,158 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 22:03:11,166 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 22:03:11,167 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 22:03:11,175 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676152991172,5,FailOnTimeoutGroup] 2023-02-11 22:03:11,183 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676152991175,5,FailOnTimeoutGroup] 2023-02-11 22:03:11,183 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,184 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 22:03:11,186 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,186 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,192 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45755, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:11,192 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42191, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:11,193 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:11,194 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:11,194 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a 2023-02-11 22:03:11,207 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46805] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:11,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:11,227 DEBUG [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a 2023-02-11 22:03:11,227 DEBUG [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a 2023-02-11 22:03:11,227 DEBUG [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38825 2023-02-11 22:03:11,227 DEBUG [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38825 2023-02-11 22:03:11,228 DEBUG [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:11,228 DEBUG [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:11,233 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:11,235 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:11,236 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:11,237 DEBUG [RS:1;jenkins-hbase9:42223] zookeeper.ZKUtil(162): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:11,237 DEBUG [RS:0;jenkins-hbase9:34009] zookeeper.ZKUtil(162): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:11,237 WARN [RS:1;jenkins-hbase9:42223] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:11,237 WARN [RS:0;jenkins-hbase9:34009] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:11,238 INFO [RS:1;jenkins-hbase9:42223] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:11,239 INFO [RS:0;jenkins-hbase9:34009] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:11,239 DEBUG [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/WALs/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:11,239 DEBUG [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/WALs/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:11,248 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/info 2023-02-11 22:03:11,248 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,42223,1676152989972] 2023-02-11 22:03:11,248 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,34009,1676152989925] 2023-02-11 22:03:11,249 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:11,251 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:11,251 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:11,255 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:11,256 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:11,257 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:11,257 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:11,258 DEBUG [RS:1;jenkins-hbase9:42223] zookeeper.ZKUtil(162): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:11,258 DEBUG [RS:0;jenkins-hbase9:34009] zookeeper.ZKUtil(162): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:11,258 DEBUG [RS:1;jenkins-hbase9:42223] zookeeper.ZKUtil(162): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:11,259 DEBUG [RS:0;jenkins-hbase9:34009] zookeeper.ZKUtil(162): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:11,260 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/table 2023-02-11 22:03:11,261 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:11,262 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:11,264 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740 2023-02-11 22:03:11,265 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740 2023-02-11 22:03:11,269 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:11,271 DEBUG [RS:1;jenkins-hbase9:42223] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:11,272 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:11,271 DEBUG [RS:0;jenkins-hbase9:34009] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:11,277 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:11,278 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70373112, jitterRate=0.048641085624694824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:11,278 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676152991233Initializing all the Stores at 1676152991235 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676152991235Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152991235Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676152991235Cleaning up temporary data from old regions at 1676152991267 (+32 ms)Cleaning up detritus from prior splits at 1676152991268 (+1 ms)Region opened successfully at 1676152991278 (+10 ms) 2023-02-11 22:03:11,278 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:11,278 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:11,278 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:11,278 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:11,278 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:11,279 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:11,279 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676152991278Disabling compacts and flushes for region at 1676152991278Disabling writes for close at 1676152991278Writing region close event to WAL at 1676152991279 (+1 ms)Closed at 1676152991279 2023-02-11 22:03:11,283 INFO [RS:1;jenkins-hbase9:42223] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:11,283 INFO [RS:0;jenkins-hbase9:34009] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:11,285 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:11,285 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 22:03:11,294 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 22:03:11,310 INFO [RS:0;jenkins-hbase9:34009] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:11,310 INFO [RS:1;jenkins-hbase9:42223] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:11,310 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 22:03:11,313 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 22:03:11,317 INFO [RS:0;jenkins-hbase9:34009] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:11,317 INFO [RS:1;jenkins-hbase9:42223] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:11,317 INFO [RS:0;jenkins-hbase9:34009] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,317 INFO [RS:1;jenkins-hbase9:42223] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,318 INFO [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:11,319 INFO [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:11,327 INFO [RS:1;jenkins-hbase9:42223] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,327 INFO [RS:0;jenkins-hbase9:34009] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,327 DEBUG [RS:1;jenkins-hbase9:42223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,328 DEBUG [RS:0;jenkins-hbase9:34009] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,328 DEBUG [RS:1;jenkins-hbase9:42223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,328 DEBUG [RS:0;jenkins-hbase9:34009] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,328 DEBUG [RS:1;jenkins-hbase9:42223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,328 DEBUG [RS:0;jenkins-hbase9:34009] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,328 DEBUG [RS:1;jenkins-hbase9:42223] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,328 DEBUG [RS:0;jenkins-hbase9:34009] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,328 DEBUG [RS:1;jenkins-hbase9:42223] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,328 DEBUG [RS:0;jenkins-hbase9:34009] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,329 DEBUG [RS:1;jenkins-hbase9:42223] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:11,329 DEBUG [RS:0;jenkins-hbase9:34009] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:11,329 DEBUG [RS:1;jenkins-hbase9:42223] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,329 DEBUG [RS:0;jenkins-hbase9:34009] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,329 DEBUG [RS:1;jenkins-hbase9:42223] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,329 DEBUG [RS:0;jenkins-hbase9:34009] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,329 DEBUG [RS:1;jenkins-hbase9:42223] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,329 DEBUG [RS:0;jenkins-hbase9:34009] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,329 DEBUG [RS:1;jenkins-hbase9:42223] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,329 DEBUG [RS:0;jenkins-hbase9:34009] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:11,330 INFO [RS:1;jenkins-hbase9:42223] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,330 INFO [RS:1;jenkins-hbase9:42223] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,331 INFO [RS:1;jenkins-hbase9:42223] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,331 INFO [RS:0;jenkins-hbase9:34009] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,331 INFO [RS:0;jenkins-hbase9:34009] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,331 INFO [RS:0;jenkins-hbase9:34009] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,347 INFO [RS:1;jenkins-hbase9:42223] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:11,347 INFO [RS:0;jenkins-hbase9:34009] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:11,351 INFO [RS:0;jenkins-hbase9:34009] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34009,1676152989925-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,351 INFO [RS:1;jenkins-hbase9:42223] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42223,1676152989972-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,370 INFO [RS:1;jenkins-hbase9:42223] regionserver.Replication(203): jenkins-hbase9.apache.org,42223,1676152989972 started 2023-02-11 22:03:11,370 INFO [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,42223,1676152989972, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:42223, sessionid=0x1004569c07f0002 2023-02-11 22:03:11,370 DEBUG [RS:1;jenkins-hbase9:42223] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:11,370 DEBUG [RS:1;jenkins-hbase9:42223] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:11,370 DEBUG [RS:1;jenkins-hbase9:42223] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,42223,1676152989972' 2023-02-11 22:03:11,371 DEBUG [RS:1;jenkins-hbase9:42223] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:11,371 DEBUG [RS:1;jenkins-hbase9:42223] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:11,372 INFO [RS:0;jenkins-hbase9:34009] regionserver.Replication(203): jenkins-hbase9.apache.org,34009,1676152989925 started 2023-02-11 22:03:11,372 INFO [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,34009,1676152989925, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:34009, sessionid=0x1004569c07f0001 2023-02-11 22:03:11,372 DEBUG [RS:1;jenkins-hbase9:42223] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:11,372 DEBUG [RS:0;jenkins-hbase9:34009] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:11,372 DEBUG [RS:1;jenkins-hbase9:42223] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:11,372 DEBUG [RS:0;jenkins-hbase9:34009] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:11,373 DEBUG [RS:1;jenkins-hbase9:42223] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:11,373 DEBUG [RS:0;jenkins-hbase9:34009] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,34009,1676152989925' 2023-02-11 22:03:11,374 DEBUG [RS:1;jenkins-hbase9:42223] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,42223,1676152989972' 2023-02-11 22:03:11,374 DEBUG [RS:0;jenkins-hbase9:34009] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:11,374 DEBUG [RS:1;jenkins-hbase9:42223] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:11,374 DEBUG [RS:0;jenkins-hbase9:34009] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:11,375 DEBUG [RS:1;jenkins-hbase9:42223] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:11,375 DEBUG [RS:0;jenkins-hbase9:34009] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:11,375 DEBUG [RS:0;jenkins-hbase9:34009] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:11,375 DEBUG [RS:1;jenkins-hbase9:42223] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:11,375 DEBUG [RS:0;jenkins-hbase9:34009] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:11,376 DEBUG [RS:0;jenkins-hbase9:34009] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,34009,1676152989925' 2023-02-11 22:03:11,376 INFO [RS:1;jenkins-hbase9:42223] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:11,376 DEBUG [RS:0;jenkins-hbase9:34009] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:11,376 INFO [RS:1;jenkins-hbase9:42223] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:11,377 DEBUG [RS:0;jenkins-hbase9:34009] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:11,377 DEBUG [RS:0;jenkins-hbase9:34009] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:11,377 INFO [RS:0;jenkins-hbase9:34009] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:11,378 INFO [RS:0;jenkins-hbase9:34009] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:11,466 DEBUG [jenkins-hbase9:46805] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 22:03:11,470 DEBUG [jenkins-hbase9:46805] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:11,476 DEBUG [jenkins-hbase9:46805] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:11,476 DEBUG [jenkins-hbase9:46805] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:11,476 DEBUG [jenkins-hbase9:46805] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:11,479 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,42223,1676152989972, state=OPENING 2023-02-11 22:03:11,488 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 22:03:11,490 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:11,490 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:11,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42223,1676152989972}] 2023-02-11 22:03:11,680 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:11,682 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 22:03:11,685 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48436, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 22:03:11,697 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 22:03:11,697 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:11,701 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C42223%2C1676152989972.meta, suffix=.meta, logDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/WALs/jenkins-hbase9.apache.org,42223,1676152989972, archiveDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/oldWALs, maxLogs=32 2023-02-11 22:03:11,723 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36967,DS-08face37-bd45-425b-bc4e-51d0b902cc4b,DISK] 2023-02-11 22:03:11,723 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39245,DS-89900f8e-96f4-459e-a879-bcafd4fa047f,DISK] 2023-02-11 22:03:11,727 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/WALs/jenkins-hbase9.apache.org,42223,1676152989972/jenkins-hbase9.apache.org%2C42223%2C1676152989972.meta.1676152991704.meta 2023-02-11 22:03:11,728 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36967,DS-08face37-bd45-425b-bc4e-51d0b902cc4b,DISK], DatanodeInfoWithStorage[127.0.0.1:39245,DS-89900f8e-96f4-459e-a879-bcafd4fa047f,DISK]] 2023-02-11 22:03:11,728 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:11,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 22:03:11,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 22:03:11,751 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 22:03:11,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 22:03:11,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:11,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 22:03:11,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 22:03:11,760 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:11,761 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/info 2023-02-11 22:03:11,762 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/info 2023-02-11 22:03:11,763 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:11,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:11,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:11,766 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:11,766 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:11,767 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:11,767 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:11,768 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:11,769 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/table 2023-02-11 22:03:11,769 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/table 2023-02-11 22:03:11,770 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:11,771 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:11,772 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740 2023-02-11 22:03:11,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740 2023-02-11 22:03:11,779 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:11,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:11,783 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65025985, jitterRate=-0.031037315726280212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:11,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676152991757Writing region info on filesystem at 1676152991758 (+1 ms)Initializing all the Stores at 1676152991759 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676152991759Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152991760 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676152991760Cleaning up temporary data from old regions at 1676152991777 (+17 ms)Cleaning up detritus from prior splits at 1676152991778 (+1 ms)Running coprocessor post-open hooks at 1676152991783 (+5 ms)Region opened successfully at 1676152991783 2023-02-11 22:03:11,793 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676152991672 2023-02-11 22:03:11,812 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 22:03:11,813 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 22:03:11,813 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,42223,1676152989972, state=OPEN 2023-02-11 22:03:11,816 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 22:03:11,817 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:11,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 22:03:11,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42223,1676152989972 in 321 msec 2023-02-11 22:03:11,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 22:03:11,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 529 msec 2023-02-11 22:03:11,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 840 msec 2023-02-11 22:03:11,831 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676152990029, completionTime=-1 2023-02-11 22:03:11,832 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 22:03:11,832 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 22:03:11,898 DEBUG [hconnection-0x5601a16e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:11,901 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48446, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:11,919 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 22:03:11,920 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676153051920 2023-02-11 22:03:11,920 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676153111920 2023-02-11 22:03:11,920 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 88 msec 2023-02-11 22:03:11,949 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,46805,1676152988691-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,950 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,46805,1676152988691-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,950 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,46805,1676152988691-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,952 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:46805, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,952 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:11,959 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 22:03:11,967 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 22:03:11,968 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:11,978 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 22:03:11,980 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:11,984 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:12,006 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe 2023-02-11 22:03:12,009 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe empty. 2023-02-11 22:03:12,010 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe 2023-02-11 22:03:12,010 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 22:03:12,042 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:12,045 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3c6b21a8ffaa54a0d6f207ebbe3166fe, NAME => 'hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp 2023-02-11 22:03:12,064 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:12,064 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 3c6b21a8ffaa54a0d6f207ebbe3166fe, disabling compactions & flushes 2023-02-11 22:03:12,064 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. 2023-02-11 22:03:12,064 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. 2023-02-11 22:03:12,064 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. after waiting 0 ms 2023-02-11 22:03:12,064 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. 2023-02-11 22:03:12,064 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. 2023-02-11 22:03:12,064 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 3c6b21a8ffaa54a0d6f207ebbe3166fe: Waiting for close lock at 1676152992064Disabling compacts and flushes for region at 1676152992064Disabling writes for close at 1676152992064Writing region close event to WAL at 1676152992064Closed at 1676152992064 2023-02-11 22:03:12,069 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:12,084 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676152992072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676152992072"}]},"ts":"1676152992072"} 2023-02-11 22:03:12,112 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 22:03:12,114 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:12,119 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676152992115"}]},"ts":"1676152992115"} 2023-02-11 22:03:12,124 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 22:03:12,128 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:12,130 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:12,130 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:12,130 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:12,132 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3c6b21a8ffaa54a0d6f207ebbe3166fe, ASSIGN}] 2023-02-11 22:03:12,135 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3c6b21a8ffaa54a0d6f207ebbe3166fe, ASSIGN 2023-02-11 22:03:12,137 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3c6b21a8ffaa54a0d6f207ebbe3166fe, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34009,1676152989925; forceNewPlan=false, retain=false 2023-02-11 22:03:12,289 INFO [jenkins-hbase9:46805] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 22:03:12,290 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3c6b21a8ffaa54a0d6f207ebbe3166fe, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:12,291 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676152992290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676152992290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676152992290"}]},"ts":"1676152992290"} 2023-02-11 22:03:12,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3c6b21a8ffaa54a0d6f207ebbe3166fe, server=jenkins-hbase9.apache.org,34009,1676152989925}] 2023-02-11 22:03:12,388 INFO [RS:0;jenkins-hbase9:34009] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C34009%2C1676152989925, suffix=, logDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/WALs/jenkins-hbase9.apache.org,34009,1676152989925, archiveDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/oldWALs, maxLogs=32 2023-02-11 22:03:12,388 INFO [RS:1;jenkins-hbase9:42223] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C42223%2C1676152989972, suffix=, logDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/WALs/jenkins-hbase9.apache.org,42223,1676152989972, archiveDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/oldWALs, maxLogs=32 2023-02-11 22:03:12,408 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36967,DS-08face37-bd45-425b-bc4e-51d0b902cc4b,DISK] 2023-02-11 22:03:12,409 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39245,DS-89900f8e-96f4-459e-a879-bcafd4fa047f,DISK] 2023-02-11 22:03:12,409 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36967,DS-08face37-bd45-425b-bc4e-51d0b902cc4b,DISK] 2023-02-11 22:03:12,412 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39245,DS-89900f8e-96f4-459e-a879-bcafd4fa047f,DISK] 2023-02-11 22:03:12,415 INFO [RS:0;jenkins-hbase9:34009] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/WALs/jenkins-hbase9.apache.org,34009,1676152989925/jenkins-hbase9.apache.org%2C34009%2C1676152989925.1676152992390 2023-02-11 22:03:12,416 DEBUG [RS:0;jenkins-hbase9:34009] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39245,DS-89900f8e-96f4-459e-a879-bcafd4fa047f,DISK], DatanodeInfoWithStorage[127.0.0.1:36967,DS-08face37-bd45-425b-bc4e-51d0b902cc4b,DISK]] 2023-02-11 22:03:12,417 INFO [RS:1;jenkins-hbase9:42223] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/WALs/jenkins-hbase9.apache.org,42223,1676152989972/jenkins-hbase9.apache.org%2C42223%2C1676152989972.1676152992390 2023-02-11 22:03:12,420 DEBUG [RS:1;jenkins-hbase9:42223] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36967,DS-08face37-bd45-425b-bc4e-51d0b902cc4b,DISK], DatanodeInfoWithStorage[127.0.0.1:39245,DS-89900f8e-96f4-459e-a879-bcafd4fa047f,DISK]] 2023-02-11 22:03:12,450 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:12,450 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 22:03:12,452 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 22:03:12,459 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. 2023-02-11 22:03:12,459 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3c6b21a8ffaa54a0d6f207ebbe3166fe, NAME => 'hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:12,460 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3c6b21a8ffaa54a0d6f207ebbe3166fe 2023-02-11 22:03:12,460 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:12,460 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 3c6b21a8ffaa54a0d6f207ebbe3166fe 2023-02-11 22:03:12,460 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 3c6b21a8ffaa54a0d6f207ebbe3166fe 2023-02-11 22:03:12,462 INFO [StoreOpener-3c6b21a8ffaa54a0d6f207ebbe3166fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3c6b21a8ffaa54a0d6f207ebbe3166fe 2023-02-11 22:03:12,464 DEBUG [StoreOpener-3c6b21a8ffaa54a0d6f207ebbe3166fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe/info 2023-02-11 22:03:12,464 DEBUG [StoreOpener-3c6b21a8ffaa54a0d6f207ebbe3166fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe/info 2023-02-11 22:03:12,465 INFO [StoreOpener-3c6b21a8ffaa54a0d6f207ebbe3166fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c6b21a8ffaa54a0d6f207ebbe3166fe columnFamilyName info 2023-02-11 22:03:12,465 INFO [StoreOpener-3c6b21a8ffaa54a0d6f207ebbe3166fe-1] regionserver.HStore(310): Store=3c6b21a8ffaa54a0d6f207ebbe3166fe/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:12,467 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe 2023-02-11 22:03:12,468 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe 2023-02-11 22:03:12,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 3c6b21a8ffaa54a0d6f207ebbe3166fe 2023-02-11 22:03:12,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:12,477 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 3c6b21a8ffaa54a0d6f207ebbe3166fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59215630, jitterRate=-0.11761835217475891}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:12,477 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 3c6b21a8ffaa54a0d6f207ebbe3166fe: Running coprocessor pre-open hook at 1676152992460Writing region info on filesystem at 1676152992460Initializing all the Stores at 1676152992462 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676152992462Cleaning up temporary data from old regions at 1676152992468 (+6 ms)Cleaning up detritus from prior splits at 1676152992469 (+1 ms)Running coprocessor post-open hooks at 1676152992477 (+8 ms)Region opened successfully at 1676152992477 2023-02-11 22:03:12,479 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe., pid=6, masterSystemTime=1676152992450 2023-02-11 22:03:12,484 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. 2023-02-11 22:03:12,484 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. 2023-02-11 22:03:12,486 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3c6b21a8ffaa54a0d6f207ebbe3166fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:12,486 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676152992485"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676152992485"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676152992485"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676152992485"}]},"ts":"1676152992485"} 2023-02-11 22:03:12,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 22:03:12,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3c6b21a8ffaa54a0d6f207ebbe3166fe, server=jenkins-hbase9.apache.org,34009,1676152989925 in 197 msec 2023-02-11 22:03:12,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 22:03:12,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3c6b21a8ffaa54a0d6f207ebbe3166fe, ASSIGN in 364 msec 2023-02-11 22:03:12,501 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:12,502 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676152992501"}]},"ts":"1676152992501"} 2023-02-11 22:03:12,505 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 22:03:12,508 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:12,511 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 539 msec 2023-02-11 22:03:12,581 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 22:03:12,583 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:12,583 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:12,608 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:12,611 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54004, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:12,626 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 22:03:12,648 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:12,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-02-11 22:03:12,660 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 22:03:12,672 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:12,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-02-11 22:03:12,686 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 22:03:12,689 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 22:03:12,690 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.648sec 2023-02-11 22:03:12,692 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 22:03:12,694 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 22:03:12,694 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 22:03:12,695 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,46805,1676152988691-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 22:03:12,696 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,46805,1676152988691-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 22:03:12,705 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 22:03:12,709 DEBUG [Listener at localhost/34175] zookeeper.ReadOnlyZKClient(139): Connect 0x030f8fa7 to 127.0.0.1:58719 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:12,714 DEBUG [Listener at localhost/34175] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d1e85c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:12,745 DEBUG [hconnection-0x264ab037-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:12,757 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48462, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:12,768 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,46805,1676152988691 2023-02-11 22:03:12,768 DEBUG [Listener at localhost/34175] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 22:03:12,777 DEBUG [Listener at localhost/34175] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 22:03:12,780 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50770, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 22:03:12,785 INFO [Listener at localhost/34175] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 22:03:12,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-11 22:03:12,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 22:03:12,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.2.10:50770 deadline: 1676153052788, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-11 22:03:12,807 INFO [Listener at localhost/34175] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-11 22:03:12,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:12,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-11 22:03:12,824 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:12,827 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:12,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-11 22:03:12,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:12,849 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:12,849 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:12,849 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:12,850 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:12,850 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:12,850 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:12,850 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0 2023-02-11 22:03:12,850 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:12,850 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c empty. 2023-02-11 22:03:12,851 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85 empty. 2023-02-11 22:03:12,851 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935 empty. 2023-02-11 22:03:12,851 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6 empty. 2023-02-11 22:03:12,853 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098 empty. 2023-02-11 22:03:12,853 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:12,853 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:12,853 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94 empty. 2023-02-11 22:03:12,853 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:12,853 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0 empty. 2023-02-11 22:03:12,853 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:12,854 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a empty. 2023-02-11 22:03:12,854 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc empty. 2023-02-11 22:03:12,854 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:12,854 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:12,854 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:12,855 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7 empty. 2023-02-11 22:03:12,855 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:12,855 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:12,855 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:12,855 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0 2023-02-11 22:03:12,855 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:12,856 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 22:03:12,879 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:12,882 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => bfc034d276e222013aeb52773a06afd6, NAME => 'testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp 2023-02-11 22:03:12,882 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0519adef6e85fa187149abd26f95f098, NAME => 'testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp 2023-02-11 22:03:12,882 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5463b0e9cdead8e921a4e0076db0f66c, NAME => 'testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp 2023-02-11 22:03:12,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:12,959 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:12,959 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing bfc034d276e222013aeb52773a06afd6, disabling compactions & flushes 2023-02-11 22:03:12,959 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:12,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:12,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. after waiting 0 ms 2023-02-11 22:03:12,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:12,960 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:12,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for bfc034d276e222013aeb52773a06afd6: Waiting for close lock at 1676152992959Disabling compacts and flushes for region at 1676152992959Disabling writes for close at 1676152992960 (+1 ms)Writing region close event to WAL at 1676152992960Closed at 1676152992960 2023-02-11 22:03:12,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:12,961 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => f4cad0c1194b343e8e4a32ae9e644935, NAME => 'testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp 2023-02-11 22:03:12,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 0519adef6e85fa187149abd26f95f098, disabling compactions & flushes 2023-02-11 22:03:12,961 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:12,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:12,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. after waiting 0 ms 2023-02-11 22:03:12,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:12,962 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:12,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 0519adef6e85fa187149abd26f95f098: Waiting for close lock at 1676152992961Disabling compacts and flushes for region at 1676152992961Disabling writes for close at 1676152992962 (+1 ms)Writing region close event to WAL at 1676152992962Closed at 1676152992962 2023-02-11 22:03:12,963 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => f94672b7a9e77d5e94937bdc8274bd85, NAME => 'testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp 2023-02-11 22:03:12,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:12,983 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing f4cad0c1194b343e8e4a32ae9e644935, disabling compactions & flushes 2023-02-11 22:03:12,983 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:12,983 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:12,983 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. after waiting 0 ms 2023-02-11 22:03:12,983 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:12,983 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:12,983 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for f4cad0c1194b343e8e4a32ae9e644935: Waiting for close lock at 1676152992983Disabling compacts and flushes for region at 1676152992983Disabling writes for close at 1676152992983Writing region close event to WAL at 1676152992983Closed at 1676152992983 2023-02-11 22:03:12,984 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 870d3bbd554356b61360331b0eb3e04a, NAME => 'testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp 2023-02-11 22:03:12,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:12,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing f94672b7a9e77d5e94937bdc8274bd85, disabling compactions & flushes 2023-02-11 22:03:12,985 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:12,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:12,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. after waiting 0 ms 2023-02-11 22:03:12,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:12,985 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:12,986 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for f94672b7a9e77d5e94937bdc8274bd85: Waiting for close lock at 1676152992985Disabling compacts and flushes for region at 1676152992985Disabling writes for close at 1676152992985Writing region close event to WAL at 1676152992985Closed at 1676152992985 2023-02-11 22:03:12,986 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 961f290dab68a52635871a37265197e0, NAME => 'testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp 2023-02-11 22:03:13,004 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,005 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 961f290dab68a52635871a37265197e0, disabling compactions & flushes 2023-02-11 22:03:13,005 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:13,005 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:13,005 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. after waiting 0 ms 2023-02-11 22:03:13,005 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:13,005 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:13,005 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 961f290dab68a52635871a37265197e0: Waiting for close lock at 1676152993005Disabling compacts and flushes for region at 1676152993005Disabling writes for close at 1676152993005Writing region close event to WAL at 1676152993005Closed at 1676152993005 2023-02-11 22:03:13,005 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3be2765ad731f78cd1d3670b14ea6f94, NAME => 'testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp 2023-02-11 22:03:13,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 3be2765ad731f78cd1d3670b14ea6f94, disabling compactions & flushes 2023-02-11 22:03:13,017 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:13,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:13,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. after waiting 0 ms 2023-02-11 22:03:13,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:13,017 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:13,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 3be2765ad731f78cd1d3670b14ea6f94: Waiting for close lock at 1676152993017Disabling compacts and flushes for region at 1676152993017Disabling writes for close at 1676152993017Writing region close event to WAL at 1676152993017Closed at 1676152993017 2023-02-11 22:03:13,018 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 070a5c745f9f5c517b1901b17b8947dc, NAME => 'testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp 2023-02-11 22:03:13,029 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,029 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 070a5c745f9f5c517b1901b17b8947dc, disabling compactions & flushes 2023-02-11 22:03:13,029 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:13,029 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:13,029 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. after waiting 0 ms 2023-02-11 22:03:13,029 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:13,029 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:13,030 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 070a5c745f9f5c517b1901b17b8947dc: Waiting for close lock at 1676152993029Disabling compacts and flushes for region at 1676152993029Disabling writes for close at 1676152993029Writing region close event to WAL at 1676152993029Closed at 1676152993029 2023-02-11 22:03:13,030 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8a388f03d58c0b175fddfdd1441825c7, NAME => 'testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp 2023-02-11 22:03:13,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 8a388f03d58c0b175fddfdd1441825c7, disabling compactions & flushes 2023-02-11 22:03:13,045 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:13,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:13,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. after waiting 0 ms 2023-02-11 22:03:13,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:13,046 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:13,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 8a388f03d58c0b175fddfdd1441825c7: Waiting for close lock at 1676152993045Disabling compacts and flushes for region at 1676152993045Disabling writes for close at 1676152993046 (+1 ms)Writing region close event to WAL at 1676152993046Closed at 1676152993046 2023-02-11 22:03:13,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:13,365 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,366 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5463b0e9cdead8e921a4e0076db0f66c, disabling compactions & flushes 2023-02-11 22:03:13,366 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:13,366 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:13,366 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. after waiting 0 ms 2023-02-11 22:03:13,366 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:13,366 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:13,366 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5463b0e9cdead8e921a4e0076db0f66c: Waiting for close lock at 1676152993366Disabling compacts and flushes for region at 1676152993366Disabling writes for close at 1676152993366Writing region close event to WAL at 1676152993366Closed at 1676152993366 2023-02-11 22:03:13,405 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,405 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 870d3bbd554356b61360331b0eb3e04a, disabling compactions & flushes 2023-02-11 22:03:13,405 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:13,405 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:13,405 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. after waiting 0 ms 2023-02-11 22:03:13,405 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:13,405 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:13,405 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 870d3bbd554356b61360331b0eb3e04a: Waiting for close lock at 1676152993405Disabling compacts and flushes for region at 1676152993405Disabling writes for close at 1676152993405Writing region close event to WAL at 1676152993405Closed at 1676152993405 2023-02-11 22:03:13,410 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:13,412 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676152993411"}]},"ts":"1676152993411"} 2023-02-11 22:03:13,412 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676152993411"}]},"ts":"1676152993411"} 2023-02-11 22:03:13,412 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676152993411"}]},"ts":"1676152993411"} 2023-02-11 22:03:13,412 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676152993411"}]},"ts":"1676152993411"} 2023-02-11 22:03:13,412 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676152992815.961f290dab68a52635871a37265197e0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676152993411"}]},"ts":"1676152993411"} 2023-02-11 22:03:13,413 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676152993411"}]},"ts":"1676152993411"} 2023-02-11 22:03:13,413 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676152993411"}]},"ts":"1676152993411"} 2023-02-11 22:03:13,413 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676152993411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676152993411"}]},"ts":"1676152993411"} 2023-02-11 22:03:13,413 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676152993411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676152993411"}]},"ts":"1676152993411"} 2023-02-11 22:03:13,413 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676152993411"}]},"ts":"1676152993411"} 2023-02-11 22:03:13,461 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-11 22:03:13,463 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:13,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:13,463 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676152993463"}]},"ts":"1676152993463"} 2023-02-11 22:03:13,465 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-11 22:03:13,469 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:13,480 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:13,481 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:13,481 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:13,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5463b0e9cdead8e921a4e0076db0f66c, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0519adef6e85fa187149abd26f95f098, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bfc034d276e222013aeb52773a06afd6, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f4cad0c1194b343e8e4a32ae9e644935, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f94672b7a9e77d5e94937bdc8274bd85, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=870d3bbd554356b61360331b0eb3e04a, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=961f290dab68a52635871a37265197e0, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3be2765ad731f78cd1d3670b14ea6f94, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=070a5c745f9f5c517b1901b17b8947dc, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8a388f03d58c0b175fddfdd1441825c7, ASSIGN}] 2023-02-11 22:03:13,485 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8a388f03d58c0b175fddfdd1441825c7, ASSIGN 2023-02-11 22:03:13,485 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3be2765ad731f78cd1d3670b14ea6f94, ASSIGN 2023-02-11 22:03:13,486 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=070a5c745f9f5c517b1901b17b8947dc, ASSIGN 2023-02-11 22:03:13,486 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=961f290dab68a52635871a37265197e0, ASSIGN 2023-02-11 22:03:13,487 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8a388f03d58c0b175fddfdd1441825c7, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42223,1676152989972; forceNewPlan=false, retain=false 2023-02-11 22:03:13,487 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=870d3bbd554356b61360331b0eb3e04a, ASSIGN 2023-02-11 22:03:13,487 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3be2765ad731f78cd1d3670b14ea6f94, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42223,1676152989972; forceNewPlan=false, retain=false 2023-02-11 22:03:13,487 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=961f290dab68a52635871a37265197e0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34009,1676152989925; forceNewPlan=false, retain=false 2023-02-11 22:03:13,487 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=070a5c745f9f5c517b1901b17b8947dc, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34009,1676152989925; forceNewPlan=false, retain=false 2023-02-11 22:03:13,489 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f94672b7a9e77d5e94937bdc8274bd85, ASSIGN 2023-02-11 22:03:13,489 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=870d3bbd554356b61360331b0eb3e04a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42223,1676152989972; forceNewPlan=false, retain=false 2023-02-11 22:03:13,489 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f4cad0c1194b343e8e4a32ae9e644935, ASSIGN 2023-02-11 22:03:13,489 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0519adef6e85fa187149abd26f95f098, ASSIGN 2023-02-11 22:03:13,489 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bfc034d276e222013aeb52773a06afd6, ASSIGN 2023-02-11 22:03:13,490 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f94672b7a9e77d5e94937bdc8274bd85, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42223,1676152989972; forceNewPlan=false, retain=false 2023-02-11 22:03:13,490 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5463b0e9cdead8e921a4e0076db0f66c, ASSIGN 2023-02-11 22:03:13,491 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f4cad0c1194b343e8e4a32ae9e644935, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34009,1676152989925; forceNewPlan=false, retain=false 2023-02-11 22:03:13,491 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0519adef6e85fa187149abd26f95f098, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42223,1676152989972; forceNewPlan=false, retain=false 2023-02-11 22:03:13,491 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bfc034d276e222013aeb52773a06afd6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34009,1676152989925; forceNewPlan=false, retain=false 2023-02-11 22:03:13,492 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5463b0e9cdead8e921a4e0076db0f66c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34009,1676152989925; forceNewPlan=false, retain=false 2023-02-11 22:03:13,638 INFO [jenkins-hbase9:46805] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-11 22:03:13,643 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=0519adef6e85fa187149abd26f95f098, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:13,643 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993643"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676152993643"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676152993643"}]},"ts":"1676152993643"} 2023-02-11 22:03:13,644 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f94672b7a9e77d5e94937bdc8274bd85, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:13,644 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8a388f03d58c0b175fddfdd1441825c7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:13,644 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=870d3bbd554356b61360331b0eb3e04a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:13,644 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993644"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676152993644"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676152993644"}]},"ts":"1676152993644"} 2023-02-11 22:03:13,644 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676152993644"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676152993644"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676152993644"}]},"ts":"1676152993644"} 2023-02-11 22:03:13,645 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993644"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676152993644"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676152993644"}]},"ts":"1676152993644"} 2023-02-11 22:03:13,645 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3be2765ad731f78cd1d3670b14ea6f94, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:13,645 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676152993645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676152993645"}]},"ts":"1676152993645"} 2023-02-11 22:03:13,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=12, state=RUNNABLE; OpenRegionProcedure 0519adef6e85fa187149abd26f95f098, server=jenkins-hbase9.apache.org,42223,1676152989972}] 2023-02-11 22:03:13,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=15, state=RUNNABLE; OpenRegionProcedure f94672b7a9e77d5e94937bdc8274bd85, server=jenkins-hbase9.apache.org,42223,1676152989972}] 2023-02-11 22:03:13,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure 8a388f03d58c0b175fddfdd1441825c7, server=jenkins-hbase9.apache.org,42223,1676152989972}] 2023-02-11 22:03:13,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 870d3bbd554356b61360331b0eb3e04a, server=jenkins-hbase9.apache.org,42223,1676152989972}] 2023-02-11 22:03:13,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=18, state=RUNNABLE; OpenRegionProcedure 3be2765ad731f78cd1d3670b14ea6f94, server=jenkins-hbase9.apache.org,42223,1676152989972}] 2023-02-11 22:03:13,667 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=bfc034d276e222013aeb52773a06afd6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:13,668 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993667"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676152993667"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676152993667"}]},"ts":"1676152993667"} 2023-02-11 22:03:13,670 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5463b0e9cdead8e921a4e0076db0f66c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:13,671 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676152993670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676152993670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676152993670"}]},"ts":"1676152993670"} 2023-02-11 22:03:13,671 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=070a5c745f9f5c517b1901b17b8947dc, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:13,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure bfc034d276e222013aeb52773a06afd6, server=jenkins-hbase9.apache.org,34009,1676152989925}] 2023-02-11 22:03:13,671 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676152993671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676152993671"}]},"ts":"1676152993671"} 2023-02-11 22:03:13,672 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f4cad0c1194b343e8e4a32ae9e644935, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:13,672 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993672"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676152993672"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676152993672"}]},"ts":"1676152993672"} 2023-02-11 22:03:13,672 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=961f290dab68a52635871a37265197e0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:13,672 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676152992815.961f290dab68a52635871a37265197e0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993672"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676152993672"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676152993672"}]},"ts":"1676152993672"} 2023-02-11 22:03:13,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 5463b0e9cdead8e921a4e0076db0f66c, server=jenkins-hbase9.apache.org,34009,1676152989925}] 2023-02-11 22:03:13,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure 070a5c745f9f5c517b1901b17b8947dc, server=jenkins-hbase9.apache.org,34009,1676152989925}] 2023-02-11 22:03:13,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure f4cad0c1194b343e8e4a32ae9e644935, server=jenkins-hbase9.apache.org,34009,1676152989925}] 2023-02-11 22:03:13,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=17, state=RUNNABLE; OpenRegionProcedure 961f290dab68a52635871a37265197e0, server=jenkins-hbase9.apache.org,34009,1676152989925}] 2023-02-11 22:03:13,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:13,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8a388f03d58c0b175fddfdd1441825c7, NAME => 'testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-11 22:03:13,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:13,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:13,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:13,823 INFO [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:13,825 DEBUG [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/f1 2023-02-11 22:03:13,825 DEBUG [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/f1 2023-02-11 22:03:13,826 INFO [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a388f03d58c0b175fddfdd1441825c7 columnFamilyName f1 2023-02-11 22:03:13,827 INFO [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] regionserver.HStore(310): Store=8a388f03d58c0b175fddfdd1441825c7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,827 INFO [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:13,829 DEBUG [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/f2 2023-02-11 22:03:13,829 DEBUG [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/f2 2023-02-11 22:03:13,829 INFO [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a388f03d58c0b175fddfdd1441825c7 columnFamilyName f2 2023-02-11 22:03:13,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:13,832 INFO [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] regionserver.HStore(310): Store=8a388f03d58c0b175fddfdd1441825c7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f4cad0c1194b343e8e4a32ae9e644935, NAME => 'testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-11 22:03:13,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:13,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:13,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:13,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:13,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:13,836 INFO [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:13,838 DEBUG [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1 2023-02-11 22:03:13,839 DEBUG [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1 2023-02-11 22:03:13,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:13,839 INFO [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4cad0c1194b343e8e4a32ae9e644935 columnFamilyName f1 2023-02-11 22:03:13,840 INFO [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] regionserver.HStore(310): Store=f4cad0c1194b343e8e4a32ae9e644935/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,840 INFO [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:13,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:13,842 DEBUG [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2 2023-02-11 22:03:13,842 DEBUG [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2 2023-02-11 22:03:13,843 INFO [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4cad0c1194b343e8e4a32ae9e644935 columnFamilyName f2 2023-02-11 22:03:13,844 INFO [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] regionserver.HStore(310): Store=f4cad0c1194b343e8e4a32ae9e644935/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:13,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:13,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 8a388f03d58c0b175fddfdd1441825c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62537135, jitterRate=-0.06812407076358795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:13,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 8a388f03d58c0b175fddfdd1441825c7: Running coprocessor pre-open hook at 1676152993821Writing region info on filesystem at 1676152993821Initializing all the Stores at 1676152993823 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993823Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993823Cleaning up temporary data from old regions at 1676152993837 (+14 ms)Cleaning up detritus from prior splits at 1676152993838 (+1 ms)Running coprocessor post-open hooks at 1676152993848 (+10 ms)Region opened successfully at 1676152993848 2023-02-11 22:03:13,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:13,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7., pid=23, masterSystemTime=1676152993813 2023-02-11 22:03:13,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:13,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:13,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:13,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:13,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f94672b7a9e77d5e94937bdc8274bd85, NAME => 'testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-11 22:03:13,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:13,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:13,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:13,854 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8a388f03d58c0b175fddfdd1441825c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:13,855 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676152993854"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676152993854"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676152993854"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676152993854"}]},"ts":"1676152993854"} 2023-02-11 22:03:13,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:13,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-11 22:03:13,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure 8a388f03d58c0b175fddfdd1441825c7, server=jenkins-hbase9.apache.org,42223,1676152989972 in 199 msec 2023-02-11 22:03:13,862 INFO [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:13,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:13,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8a388f03d58c0b175fddfdd1441825c7, ASSIGN in 380 msec 2023-02-11 22:03:13,864 DEBUG [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1 2023-02-11 22:03:13,864 DEBUG [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1 2023-02-11 22:03:13,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened f4cad0c1194b343e8e4a32ae9e644935; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70983670, jitterRate=0.05773910880088806}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:13,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for f4cad0c1194b343e8e4a32ae9e644935: Running coprocessor pre-open hook at 1676152993835Writing region info on filesystem at 1676152993835Initializing all the Stores at 1676152993836 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993836Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993836Cleaning up temporary data from old regions at 1676152993850 (+14 ms)Cleaning up detritus from prior splits at 1676152993851 (+1 ms)Running coprocessor post-open hooks at 1676152993865 (+14 ms)Region opened successfully at 1676152993865 2023-02-11 22:03:13,865 INFO [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f94672b7a9e77d5e94937bdc8274bd85 columnFamilyName f1 2023-02-11 22:03:13,866 INFO [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] regionserver.HStore(310): Store=f94672b7a9e77d5e94937bdc8274bd85/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935., pid=29, masterSystemTime=1676152993826 2023-02-11 22:03:13,866 INFO [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:13,868 DEBUG [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2 2023-02-11 22:03:13,868 DEBUG [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2 2023-02-11 22:03:13,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:13,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:13,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:13,869 INFO [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f94672b7a9e77d5e94937bdc8274bd85 columnFamilyName f2 2023-02-11 22:03:13,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 961f290dab68a52635871a37265197e0, NAME => 'testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-11 22:03:13,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 961f290dab68a52635871a37265197e0 2023-02-11 22:03:13,869 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f4cad0c1194b343e8e4a32ae9e644935, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:13,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,870 INFO [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] regionserver.HStore(310): Store=f94672b7a9e77d5e94937bdc8274bd85/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 961f290dab68a52635871a37265197e0 2023-02-11 22:03:13,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 961f290dab68a52635871a37265197e0 2023-02-11 22:03:13,871 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993869"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676152993869"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676152993869"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676152993869"}]},"ts":"1676152993869"} 2023-02-11 22:03:13,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:13,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:13,873 INFO [StoreOpener-961f290dab68a52635871a37265197e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 961f290dab68a52635871a37265197e0 2023-02-11 22:03:13,875 DEBUG [StoreOpener-961f290dab68a52635871a37265197e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1 2023-02-11 22:03:13,876 DEBUG [StoreOpener-961f290dab68a52635871a37265197e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1 2023-02-11 22:03:13,876 INFO [StoreOpener-961f290dab68a52635871a37265197e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 961f290dab68a52635871a37265197e0 columnFamilyName f1 2023-02-11 22:03:13,877 INFO [StoreOpener-961f290dab68a52635871a37265197e0-1] regionserver.HStore(310): Store=961f290dab68a52635871a37265197e0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,877 INFO [StoreOpener-961f290dab68a52635871a37265197e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 961f290dab68a52635871a37265197e0 2023-02-11 22:03:13,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-11 22:03:13,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure f4cad0c1194b343e8e4a32ae9e644935, server=jenkins-hbase9.apache.org,34009,1676152989925 in 196 msec 2023-02-11 22:03:13,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:13,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f4cad0c1194b343e8e4a32ae9e644935, ASSIGN in 397 msec 2023-02-11 22:03:13,890 DEBUG [StoreOpener-961f290dab68a52635871a37265197e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2 2023-02-11 22:03:13,890 DEBUG [StoreOpener-961f290dab68a52635871a37265197e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2 2023-02-11 22:03:13,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:13,891 INFO [StoreOpener-961f290dab68a52635871a37265197e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 961f290dab68a52635871a37265197e0 columnFamilyName f2 2023-02-11 22:03:13,892 INFO [StoreOpener-961f290dab68a52635871a37265197e0-1] regionserver.HStore(310): Store=961f290dab68a52635871a37265197e0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:13,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0 2023-02-11 22:03:13,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened f94672b7a9e77d5e94937bdc8274bd85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61102668, jitterRate=-0.08949929475784302}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:13,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for f94672b7a9e77d5e94937bdc8274bd85: Running coprocessor pre-open hook at 1676152993854Writing region info on filesystem at 1676152993854Initializing all the Stores at 1676152993856 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993856Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993862 (+6 ms)Cleaning up temporary data from old regions at 1676152993874 (+12 ms)Cleaning up detritus from prior splits at 1676152993875 (+1 ms)Running coprocessor post-open hooks at 1676152993895 (+20 ms)Region opened successfully at 1676152993895 2023-02-11 22:03:13,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0 2023-02-11 22:03:13,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85., pid=22, masterSystemTime=1676152993813 2023-02-11 22:03:13,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:13,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:13,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:13,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 870d3bbd554356b61360331b0eb3e04a, NAME => 'testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-11 22:03:13,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:13,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:13,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,900 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f94672b7a9e77d5e94937bdc8274bd85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:13,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:13,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:13,901 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993900"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676152993900"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676152993900"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676152993900"}]},"ts":"1676152993900"} 2023-02-11 22:03:13,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 961f290dab68a52635871a37265197e0 2023-02-11 22:03:13,903 INFO [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:13,906 DEBUG [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1 2023-02-11 22:03:13,906 DEBUG [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1 2023-02-11 22:03:13,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:13,907 INFO [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 870d3bbd554356b61360331b0eb3e04a columnFamilyName f1 2023-02-11 22:03:13,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 961f290dab68a52635871a37265197e0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62292087, jitterRate=-0.07177557051181793}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:13,908 INFO [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] regionserver.HStore(310): Store=870d3bbd554356b61360331b0eb3e04a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 961f290dab68a52635871a37265197e0: Running coprocessor pre-open hook at 1676152993871Writing region info on filesystem at 1676152993871Initializing all the Stores at 1676152993872 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993872Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993873 (+1 ms)Cleaning up temporary data from old regions at 1676152993897 (+24 ms)Cleaning up detritus from prior splits at 1676152993899 (+2 ms)Running coprocessor post-open hooks at 1676152993908 (+9 ms)Region opened successfully at 1676152993908 2023-02-11 22:03:13,909 INFO [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:13,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=15 2023-02-11 22:03:13,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=15, state=SUCCESS; OpenRegionProcedure f94672b7a9e77d5e94937bdc8274bd85, server=jenkins-hbase9.apache.org,42223,1676152989972 in 249 msec 2023-02-11 22:03:13,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0., pid=30, masterSystemTime=1676152993826 2023-02-11 22:03:13,911 DEBUG [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2 2023-02-11 22:03:13,911 DEBUG [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2 2023-02-11 22:03:13,912 INFO [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 870d3bbd554356b61360331b0eb3e04a columnFamilyName f2 2023-02-11 22:03:13,918 INFO [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] regionserver.HStore(310): Store=870d3bbd554356b61360331b0eb3e04a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:13,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:13,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f94672b7a9e77d5e94937bdc8274bd85, ASSIGN in 428 msec 2023-02-11 22:03:13,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:13,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:13,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:13,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:13,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bfc034d276e222013aeb52773a06afd6, NAME => 'testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-11 22:03:13,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:13,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,925 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=961f290dab68a52635871a37265197e0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:13,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:13,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:13,925 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676152992815.961f290dab68a52635871a37265197e0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993925"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676152993925"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676152993925"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676152993925"}]},"ts":"1676152993925"} 2023-02-11 22:03:13,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:13,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=17 2023-02-11 22:03:13,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=17, state=SUCCESS; OpenRegionProcedure 961f290dab68a52635871a37265197e0, server=jenkins-hbase9.apache.org,34009,1676152989925 in 246 msec 2023-02-11 22:03:13,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=961f290dab68a52635871a37265197e0, ASSIGN in 452 msec 2023-02-11 22:03:13,957 INFO [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:13,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:13,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 870d3bbd554356b61360331b0eb3e04a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69977447, jitterRate=0.04274521768093109}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:13,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 870d3bbd554356b61360331b0eb3e04a: Running coprocessor pre-open hook at 1676152993901Writing region info on filesystem at 1676152993901Initializing all the Stores at 1676152993902 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993902Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993903 (+1 ms)Cleaning up temporary data from old regions at 1676152993922 (+19 ms)Cleaning up detritus from prior splits at 1676152993923 (+1 ms)Running coprocessor post-open hooks at 1676152993959 (+36 ms)Region opened successfully at 1676152993959 2023-02-11 22:03:13,960 DEBUG [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1 2023-02-11 22:03:13,960 DEBUG [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1 2023-02-11 22:03:13,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a., pid=24, masterSystemTime=1676152993813 2023-02-11 22:03:13,961 INFO [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfc034d276e222013aeb52773a06afd6 columnFamilyName f1 2023-02-11 22:03:13,962 INFO [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] regionserver.HStore(310): Store=bfc034d276e222013aeb52773a06afd6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,962 INFO [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:13,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:13,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:13,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:13,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0519adef6e85fa187149abd26f95f098, NAME => 'testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-11 22:03:13,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:13,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:13,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:13,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:13,964 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=870d3bbd554356b61360331b0eb3e04a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:13,965 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152993964"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676152993964"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676152993964"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676152993964"}]},"ts":"1676152993964"} 2023-02-11 22:03:13,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:13,965 DEBUG [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2 2023-02-11 22:03:13,965 DEBUG [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2 2023-02-11 22:03:13,966 INFO [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfc034d276e222013aeb52773a06afd6 columnFamilyName f2 2023-02-11 22:03:13,967 INFO [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] regionserver.HStore(310): Store=bfc034d276e222013aeb52773a06afd6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-11 22:03:13,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 870d3bbd554356b61360331b0eb3e04a, server=jenkins-hbase9.apache.org,42223,1676152989972 in 306 msec 2023-02-11 22:03:13,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=870d3bbd554356b61360331b0eb3e04a, ASSIGN in 491 msec 2023-02-11 22:03:13,978 INFO [StoreOpener-0519adef6e85fa187149abd26f95f098-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:13,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:13,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:13,980 DEBUG [StoreOpener-0519adef6e85fa187149abd26f95f098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1 2023-02-11 22:03:13,980 DEBUG [StoreOpener-0519adef6e85fa187149abd26f95f098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1 2023-02-11 22:03:13,981 INFO [StoreOpener-0519adef6e85fa187149abd26f95f098-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0519adef6e85fa187149abd26f95f098 columnFamilyName f1 2023-02-11 22:03:13,982 INFO [StoreOpener-0519adef6e85fa187149abd26f95f098-1] regionserver.HStore(310): Store=0519adef6e85fa187149abd26f95f098/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,982 INFO [StoreOpener-0519adef6e85fa187149abd26f95f098-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:13,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:13,984 DEBUG [StoreOpener-0519adef6e85fa187149abd26f95f098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2 2023-02-11 22:03:13,985 DEBUG [StoreOpener-0519adef6e85fa187149abd26f95f098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2 2023-02-11 22:03:13,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:13,985 INFO [StoreOpener-0519adef6e85fa187149abd26f95f098-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0519adef6e85fa187149abd26f95f098 columnFamilyName f2 2023-02-11 22:03:13,986 INFO [StoreOpener-0519adef6e85fa187149abd26f95f098-1] regionserver.HStore(310): Store=0519adef6e85fa187149abd26f95f098/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:13,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:13,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:13,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:13,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened bfc034d276e222013aeb52773a06afd6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69239291, jitterRate=0.03174583613872528}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:13,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for bfc034d276e222013aeb52773a06afd6: Running coprocessor pre-open hook at 1676152993925Writing region info on filesystem at 1676152993925Initializing all the Stores at 1676152993927 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993927Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993957 (+30 ms)Cleaning up temporary data from old regions at 1676152993980 (+23 ms)Cleaning up detritus from prior splits at 1676152993981 (+1 ms)Running coprocessor post-open hooks at 1676152993994 (+13 ms)Region opened successfully at 1676152993994 2023-02-11 22:03:13,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:13,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6., pid=26, masterSystemTime=1676152993826 2023-02-11 22:03:13,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:13,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:13,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:13,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:13,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5463b0e9cdead8e921a4e0076db0f66c, NAME => 'testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-11 22:03:14,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:14,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:14,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:14,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:14,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:14,001 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=bfc034d276e222013aeb52773a06afd6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:14,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 0519adef6e85fa187149abd26f95f098; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65936646, jitterRate=-0.017467409372329712}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:14,001 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152994001"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676152994001"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676152994001"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676152994001"}]},"ts":"1676152994001"} 2023-02-11 22:03:14,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 0519adef6e85fa187149abd26f95f098: Running coprocessor pre-open hook at 1676152993964Writing region info on filesystem at 1676152993964Initializing all the Stores at 1676152993966 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993966Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152993977 (+11 ms)Cleaning up temporary data from old regions at 1676152993994 (+17 ms)Cleaning up detritus from prior splits at 1676152993994Running coprocessor post-open hooks at 1676152994001 (+7 ms)Region opened successfully at 1676152994001 2023-02-11 22:03:14,002 INFO [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:14,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098., pid=21, masterSystemTime=1676152993813 2023-02-11 22:03:14,005 DEBUG [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/f1 2023-02-11 22:03:14,005 DEBUG [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/f1 2023-02-11 22:03:14,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:14,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:14,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:14,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3be2765ad731f78cd1d3670b14ea6f94, NAME => 'testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-11 22:03:14,005 INFO [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5463b0e9cdead8e921a4e0076db0f66c columnFamilyName f1 2023-02-11 22:03:14,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:14,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:14,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:14,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:14,006 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=0519adef6e85fa187149abd26f95f098, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:14,006 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152994006"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676152994006"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676152994006"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676152994006"}]},"ts":"1676152994006"} 2023-02-11 22:03:14,007 INFO [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] regionserver.HStore(310): Store=5463b0e9cdead8e921a4e0076db0f66c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:14,007 INFO [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:14,008 INFO [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:14,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-11 22:03:14,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure bfc034d276e222013aeb52773a06afd6, server=jenkins-hbase9.apache.org,34009,1676152989925 in 333 msec 2023-02-11 22:03:14,010 DEBUG [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1 2023-02-11 22:03:14,010 DEBUG [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1 2023-02-11 22:03:14,010 INFO [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3be2765ad731f78cd1d3670b14ea6f94 columnFamilyName f1 2023-02-11 22:03:14,012 INFO [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] regionserver.HStore(310): Store=3be2765ad731f78cd1d3670b14ea6f94/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:14,012 INFO [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:14,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bfc034d276e222013aeb52773a06afd6, ASSIGN in 528 msec 2023-02-11 22:03:14,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=12 2023-02-11 22:03:14,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=12, state=SUCCESS; OpenRegionProcedure 0519adef6e85fa187149abd26f95f098, server=jenkins-hbase9.apache.org,42223,1676152989972 in 357 msec 2023-02-11 22:03:14,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0519adef6e85fa187149abd26f95f098, ASSIGN in 533 msec 2023-02-11 22:03:14,021 DEBUG [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/f2 2023-02-11 22:03:14,021 DEBUG [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/f2 2023-02-11 22:03:14,022 DEBUG [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2 2023-02-11 22:03:14,022 INFO [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5463b0e9cdead8e921a4e0076db0f66c columnFamilyName f2 2023-02-11 22:03:14,022 DEBUG [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2 2023-02-11 22:03:14,022 INFO [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3be2765ad731f78cd1d3670b14ea6f94 columnFamilyName f2 2023-02-11 22:03:14,023 INFO [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] regionserver.HStore(310): Store=5463b0e9cdead8e921a4e0076db0f66c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:14,024 INFO [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] regionserver.HStore(310): Store=3be2765ad731f78cd1d3670b14ea6f94/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:14,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:14,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:14,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:14,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:14,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:14,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:14,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:14,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:14,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:14,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 5463b0e9cdead8e921a4e0076db0f66c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74741974, jitterRate=0.11374220252037048}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:14,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 5463b0e9cdead8e921a4e0076db0f66c: Running coprocessor pre-open hook at 1676152994000Writing region info on filesystem at 1676152994000Initializing all the Stores at 1676152994001 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152994002 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152994002Cleaning up temporary data from old regions at 1676152994027 (+25 ms)Cleaning up detritus from prior splits at 1676152994027Running coprocessor post-open hooks at 1676152994033 (+6 ms)Region opened successfully at 1676152994033 2023-02-11 22:03:14,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:14,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c., pid=27, masterSystemTime=1676152993826 2023-02-11 22:03:14,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 3be2765ad731f78cd1d3670b14ea6f94; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65357984, jitterRate=-0.026090145111083984}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:14,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 3be2765ad731f78cd1d3670b14ea6f94: Running coprocessor pre-open hook at 1676152994006Writing region info on filesystem at 1676152994006Initializing all the Stores at 1676152994007 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152994007Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152994007Cleaning up temporary data from old regions at 1676152994027 (+20 ms)Cleaning up detritus from prior splits at 1676152994028 (+1 ms)Running coprocessor post-open hooks at 1676152994035 (+7 ms)Region opened successfully at 1676152994035 2023-02-11 22:03:14,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94., pid=25, masterSystemTime=1676152993813 2023-02-11 22:03:14,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:14,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:14,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:14,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 070a5c745f9f5c517b1901b17b8947dc, NAME => 'testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-11 22:03:14,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:14,038 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5463b0e9cdead8e921a4e0076db0f66c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:14,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:14,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:14,039 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676152994038"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676152994038"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676152994038"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676152994038"}]},"ts":"1676152994038"} 2023-02-11 22:03:14,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:14,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:14,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:14,040 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3be2765ad731f78cd1d3670b14ea6f94, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:14,040 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152994040"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676152994040"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676152994040"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676152994040"}]},"ts":"1676152994040"} 2023-02-11 22:03:14,041 INFO [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:14,044 DEBUG [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1 2023-02-11 22:03:14,044 DEBUG [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1 2023-02-11 22:03:14,045 INFO [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 070a5c745f9f5c517b1901b17b8947dc columnFamilyName f1 2023-02-11 22:03:14,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-11 22:03:14,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 5463b0e9cdead8e921a4e0076db0f66c, server=jenkins-hbase9.apache.org,34009,1676152989925 in 368 msec 2023-02-11 22:03:14,046 INFO [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] regionserver.HStore(310): Store=070a5c745f9f5c517b1901b17b8947dc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:14,046 INFO [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:14,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=18 2023-02-11 22:03:14,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=18, state=SUCCESS; OpenRegionProcedure 3be2765ad731f78cd1d3670b14ea6f94, server=jenkins-hbase9.apache.org,42223,1676152989972 in 381 msec 2023-02-11 22:03:14,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5463b0e9cdead8e921a4e0076db0f66c, ASSIGN in 564 msec 2023-02-11 22:03:14,048 DEBUG [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2 2023-02-11 22:03:14,048 DEBUG [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2 2023-02-11 22:03:14,048 INFO [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 070a5c745f9f5c517b1901b17b8947dc columnFamilyName f2 2023-02-11 22:03:14,049 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3be2765ad731f78cd1d3670b14ea6f94, ASSIGN in 566 msec 2023-02-11 22:03:14,049 INFO [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] regionserver.HStore(310): Store=070a5c745f9f5c517b1901b17b8947dc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:14,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:14,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:14,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:14,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:14,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:14,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 070a5c745f9f5c517b1901b17b8947dc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72329128, jitterRate=0.07778799533843994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:14,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 070a5c745f9f5c517b1901b17b8947dc: Running coprocessor pre-open hook at 1676152994039Writing region info on filesystem at 1676152994039Initializing all the Stores at 1676152994041 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152994041Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152994041Cleaning up temporary data from old regions at 1676152994052 (+11 ms)Cleaning up detritus from prior splits at 1676152994053 (+1 ms)Running coprocessor post-open hooks at 1676152994059 (+6 ms)Region opened successfully at 1676152994059 2023-02-11 22:03:14,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc., pid=28, masterSystemTime=1676152993826 2023-02-11 22:03:14,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:14,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:14,062 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=070a5c745f9f5c517b1901b17b8947dc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:14,063 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676152994062"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676152994062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676152994062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676152994062"}]},"ts":"1676152994062"} 2023-02-11 22:03:14,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-11 22:03:14,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure 070a5c745f9f5c517b1901b17b8947dc, server=jenkins-hbase9.apache.org,34009,1676152989925 in 391 msec 2023-02-11 22:03:14,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-11 22:03:14,072 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=070a5c745f9f5c517b1901b17b8947dc, ASSIGN in 588 msec 2023-02-11 22:03:14,072 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:14,073 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676152994073"}]},"ts":"1676152994073"} 2023-02-11 22:03:14,075 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-11 22:03:14,079 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:14,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.2590 sec 2023-02-11 22:03:14,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:14,968 INFO [Listener at localhost/34175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-11 22:03:14,968 DEBUG [Listener at localhost/34175] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-11 22:03:14,970 INFO [Listener at localhost/34175] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:14,980 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-11 22:03:14,981 INFO [Listener at localhost/34175] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:14,981 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-11 22:03:14,981 INFO [Listener at localhost/34175] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 22:03:15,111 DEBUG [hconnection-0x264ab037-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:15,171 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54012, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:15,223 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42223] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:15,227 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34009] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:15,573 INFO [Listener at localhost/34175] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 22:03:15,577 INFO [Listener at localhost/34175] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 22:03:15,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 22:03:15,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676152995590 (current time:1676152995590). 2023-02-11 22:03:15,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 22:03:15,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] zookeeper.ReadOnlyZKClient(139): Connect 0x54786992 to 127.0.0.1:58719 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:15,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4df59a3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:15,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:15,623 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48470, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:15,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54786992 to 127.0.0.1:58719 2023-02-11 22:03:15,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:15,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 22:03:15,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 22:03:15,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 22:03:15,649 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 22:03:15,651 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676153595651 2023-02-11 22:03:15,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 22:03:15,657 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-11 22:03:15,659 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:15,659 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 22:03:15,660 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 22:03:15,672 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 20 msec 2023-02-11 22:03:15,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 22:03:15,673 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 22:03:15,674 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676153595674 2023-02-11 22:03:15,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-11 22:03:15,715 INFO [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-11 22:03:15,715 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:15,715 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-11 22:03:15,715 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-11 22:03:15,730 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:15,730 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 22:03:15,732 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:15,732 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:15,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:15,732 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:15,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:15,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:15,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:15,732 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:15,732 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:15,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 22:03:15,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 22:03:15,733 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:15,733 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:15,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:15,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:15,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-11 22:03:15,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 22:03:15,734 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-11 22:03:15,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-11 22:03:15,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 22:03:15,734 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-11 22:03:15,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-11 22:03:15,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-11 22:03:15,739 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-11 22:03:15,739 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-11 22:03:15,739 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:15,739 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:15,739 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 22:03:15,740 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 22:03:15,740 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-11 22:03:15,740 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-11 22:03:15,740 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42223,1676152989972' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-11 22:03:15,740 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34009,1676152989925' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-11 22:03:15,744 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:15,744 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:15,744 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:15,744 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:15,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:15,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:15,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:15,744 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:15,744 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:15,744 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:15,744 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:15,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:15,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:15,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 22:03:15,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:15,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:15,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34009,1676152989925' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-11 22:03:15,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a7e9652[Count = 1] remaining members to acquire global barrier 2023-02-11 22:03:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:15,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:15,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:15,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 22:03:15,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:15,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:15,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:15,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42223,1676152989972' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-11 22:03:15,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a7e9652[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:15,750 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-11 22:03:15,750 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:15,752 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:15,752 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:15,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:15,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:15,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:15,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:15,752 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 22:03:15,752 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 22:03:15,753 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:15,754 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:15,754 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:15,754 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 22:03:15,754 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. started... 2023-02-11 22:03:15,754 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 22:03:15,754 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:15,754 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. started... 2023-02-11 22:03:15,754 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. started... 2023-02-11 22:03:15,754 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. started... 2023-02-11 22:03:15,754 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:15,754 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:15,763 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 070a5c745f9f5c517b1901b17b8947dc 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 22:03:15,763 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:15,763 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0519adef6e85fa187149abd26f95f098 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 22:03:15,763 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:15,755 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 22:03:15,764 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. started... 2023-02-11 22:03:15,764 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. started... 2023-02-11 22:03:15,764 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 961f290dab68a52635871a37265197e0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:15,765 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:15,766 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:15,766 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 8a388f03d58c0b175fddfdd1441825c7: 2023-02-11 22:03:15,764 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 22:03:15,766 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5463b0e9cdead8e921a4e0076db0f66c: 2023-02-11 22:03:15,766 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 870d3bbd554356b61360331b0eb3e04a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:15,767 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:15,767 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:15,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 22:03:15,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:15,770 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 22:03:15,772 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:15,772 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:15,778 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 22:03:15,778 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 22:03:15,778 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 22:03:15,778 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 22:03:15,952 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/.tmp/f1/e693e0b9be4e48e59e5f0a16bc5b8540 2023-02-11 22:03:15,962 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/.tmp/f1/3ab65fd16f7e471f8385886425111068 2023-02-11 22:03:15,969 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/.tmp/f1/0e9c2fd88888488d8c191f2c779f7fc3 2023-02-11 22:03:15,971 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:15,971 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/.tmp/f1/7e0f32ccc0d34ee9a3adb96c81ea401a 2023-02-11 22:03:15,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 22:03:15,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:15,973 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 22:03:16,115 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/.tmp/f2/0a627474152241bb9fb22924f0b4db22 2023-02-11 22:03:16,126 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/.tmp/f1/e693e0b9be4e48e59e5f0a16bc5b8540 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1/e693e0b9be4e48e59e5f0a16bc5b8540 2023-02-11 22:03:16,136 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/.tmp/f2/9d675feb919d4c3b958796ef40a222a4 2023-02-11 22:03:16,137 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/.tmp/f2/4e64ec6794d5407ea2f462d346a9a4b5 2023-02-11 22:03:16,148 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1/e693e0b9be4e48e59e5f0a16bc5b8540, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 22:03:16,151 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/.tmp/f2/0a627474152241bb9fb22924f0b4db22 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2/0a627474152241bb9fb22924f0b4db22 2023-02-11 22:03:16,151 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/.tmp/f1/3ab65fd16f7e471f8385886425111068 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1/3ab65fd16f7e471f8385886425111068 2023-02-11 22:03:16,152 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/.tmp/f2/e0166dc26b6740368626c2c227790adc 2023-02-11 22:03:16,159 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/.tmp/f1/0e9c2fd88888488d8c191f2c779f7fc3 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1/0e9c2fd88888488d8c191f2c779f7fc3 2023-02-11 22:03:16,163 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1/3ab65fd16f7e471f8385886425111068, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 22:03:16,164 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/.tmp/f1/7e0f32ccc0d34ee9a3adb96c81ea401a as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1/7e0f32ccc0d34ee9a3adb96c81ea401a 2023-02-11 22:03:16,167 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/.tmp/f2/9d675feb919d4c3b958796ef40a222a4 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2/9d675feb919d4c3b958796ef40a222a4 2023-02-11 22:03:16,169 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2/0a627474152241bb9fb22924f0b4db22, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 22:03:16,171 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 0519adef6e85fa187149abd26f95f098 in 408ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:16,175 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-11 22:03:16,179 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0519adef6e85fa187149abd26f95f098: 2023-02-11 22:03:16,180 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,180 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1/0e9c2fd88888488d8c191f2c779f7fc3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:16,180 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:16,180 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1/e693e0b9be4e48e59e5f0a16bc5b8540] hfiles 2023-02-11 22:03:16,180 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1/e693e0b9be4e48e59e5f0a16bc5b8540 for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,181 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/.tmp/f2/4e64ec6794d5407ea2f462d346a9a4b5 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2/4e64ec6794d5407ea2f462d346a9a4b5 2023-02-11 22:03:16,183 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1/7e0f32ccc0d34ee9a3adb96c81ea401a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:16,185 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2/0a627474152241bb9fb22924f0b4db22] hfiles 2023-02-11 22:03:16,185 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2/0a627474152241bb9fb22924f0b4db22 for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,186 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/.tmp/f2/e0166dc26b6740368626c2c227790adc as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2/e0166dc26b6740368626c2c227790adc 2023-02-11 22:03:16,189 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2/9d675feb919d4c3b958796ef40a222a4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 22:03:16,191 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 070a5c745f9f5c517b1901b17b8947dc in 428ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:16,192 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2/4e64ec6794d5407ea2f462d346a9a4b5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:16,199 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 070a5c745f9f5c517b1901b17b8947dc: 2023-02-11 22:03:16,200 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,200 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:16,201 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1/3ab65fd16f7e471f8385886425111068] hfiles 2023-02-11 22:03:16,201 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1/3ab65fd16f7e471f8385886425111068 for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,201 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 870d3bbd554356b61360331b0eb3e04a in 435ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:16,201 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2/9d675feb919d4c3b958796ef40a222a4] hfiles 2023-02-11 22:03:16,201 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 870d3bbd554356b61360331b0eb3e04a: 2023-02-11 22:03:16,201 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2/9d675feb919d4c3b958796ef40a222a4 for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,201 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,201 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:16,201 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1/0e9c2fd88888488d8c191f2c779f7fc3] hfiles 2023-02-11 22:03:16,201 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1/0e9c2fd88888488d8c191f2c779f7fc3 for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,201 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2/4e64ec6794d5407ea2f462d346a9a4b5] hfiles 2023-02-11 22:03:16,202 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2/4e64ec6794d5407ea2f462d346a9a4b5 for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,206 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2/e0166dc26b6740368626c2c227790adc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:16,208 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 961f290dab68a52635871a37265197e0 in 444ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:16,208 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 961f290dab68a52635871a37265197e0: 2023-02-11 22:03:16,208 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,208 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:16,208 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1/7e0f32ccc0d34ee9a3adb96c81ea401a] hfiles 2023-02-11 22:03:16,208 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1/7e0f32ccc0d34ee9a3adb96c81ea401a for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,208 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2/e0166dc26b6740368626c2c227790adc] hfiles 2023-02-11 22:03:16,208 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2/e0166dc26b6740368626c2c227790adc for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,220 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. completed. 2023-02-11 22:03:16,220 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:16,220 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. completed. 2023-02-11 22:03:16,221 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:16,224 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:16,224 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 22:03:16,224 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. started... 2023-02-11 22:03:16,224 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 22:03:16,224 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:16,224 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. started... 2023-02-11 22:03:16,226 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HRegion(2744): Flushing bfc034d276e222013aeb52773a06afd6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:16,226 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] regionserver.HRegion(2744): Flushing f94672b7a9e77d5e94937bdc8274bd85 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:16,240 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. completed. 2023-02-11 22:03:16,241 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:16,241 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:16,241 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 22:03:16,241 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. started... 2023-02-11 22:03:16,242 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3be2765ad731f78cd1d3670b14ea6f94 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:16,253 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. completed. 2023-02-11 22:03:16,253 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:16,253 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 22:03:16,273 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:16,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 22:03:16,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:16,284 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 22:03:16,300 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/.tmp/f1/9b948254fafa442d8746b4e4eaaa983f 2023-02-11 22:03:16,306 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/.tmp/f1/e4e34cb35ca542c2b5f1c15215ecb517 2023-02-11 22:03:16,307 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/.tmp/f1/e20b34977f0143cb9d2efe553b372a37 2023-02-11 22:03:16,334 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/.tmp/f2/1a791654312e47d49ac4ca5b516e3295 2023-02-11 22:03:16,349 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/.tmp/f2/518bcc8e7a0d4504be5fd44e80fe935d 2023-02-11 22:03:16,349 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/.tmp/f1/9b948254fafa442d8746b4e4eaaa983f as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1/9b948254fafa442d8746b4e4eaaa983f 2023-02-11 22:03:16,349 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/.tmp/f2/3e3987dbe22a4802a7ae4861691f0517 2023-02-11 22:03:16,365 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/.tmp/f1/e4e34cb35ca542c2b5f1c15215ecb517 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1/e4e34cb35ca542c2b5f1c15215ecb517 2023-02-11 22:03:16,365 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/.tmp/f1/e20b34977f0143cb9d2efe553b372a37 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1/e20b34977f0143cb9d2efe553b372a37 2023-02-11 22:03:16,374 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1/9b948254fafa442d8746b4e4eaaa983f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:16,375 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/.tmp/f2/1a791654312e47d49ac4ca5b516e3295 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2/1a791654312e47d49ac4ca5b516e3295 2023-02-11 22:03:16,376 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1/e20b34977f0143cb9d2efe553b372a37, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:16,377 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/.tmp/f2/3e3987dbe22a4802a7ae4861691f0517 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2/3e3987dbe22a4802a7ae4861691f0517 2023-02-11 22:03:16,377 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1/e4e34cb35ca542c2b5f1c15215ecb517, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:16,382 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/.tmp/f2/518bcc8e7a0d4504be5fd44e80fe935d as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2/518bcc8e7a0d4504be5fd44e80fe935d 2023-02-11 22:03:16,384 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2/1a791654312e47d49ac4ca5b516e3295, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:16,385 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bfc034d276e222013aeb52773a06afd6 in 159ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:16,385 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for bfc034d276e222013aeb52773a06afd6: 2023-02-11 22:03:16,386 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,386 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:16,386 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1/9b948254fafa442d8746b4e4eaaa983f] hfiles 2023-02-11 22:03:16,386 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1/9b948254fafa442d8746b4e4eaaa983f for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,386 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2/1a791654312e47d49ac4ca5b516e3295] hfiles 2023-02-11 22:03:16,386 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2/1a791654312e47d49ac4ca5b516e3295 for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,398 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2/518bcc8e7a0d4504be5fd44e80fe935d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:16,399 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2/3e3987dbe22a4802a7ae4861691f0517, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:16,401 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f94672b7a9e77d5e94937bdc8274bd85 in 175ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:16,402 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f94672b7a9e77d5e94937bdc8274bd85: 2023-02-11 22:03:16,402 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,402 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:16,402 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1/e20b34977f0143cb9d2efe553b372a37] hfiles 2023-02-11 22:03:16,402 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1/e20b34977f0143cb9d2efe553b372a37 for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,402 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2/3e3987dbe22a4802a7ae4861691f0517] hfiles 2023-02-11 22:03:16,402 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2/3e3987dbe22a4802a7ae4861691f0517 for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,405 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3be2765ad731f78cd1d3670b14ea6f94 in 163ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:16,405 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3be2765ad731f78cd1d3670b14ea6f94: 2023-02-11 22:03:16,405 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,405 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:16,405 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1/e4e34cb35ca542c2b5f1c15215ecb517] hfiles 2023-02-11 22:03:16,405 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1/e4e34cb35ca542c2b5f1c15215ecb517 for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,406 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2/518bcc8e7a0d4504be5fd44e80fe935d] hfiles 2023-02-11 22:03:16,406 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2/518bcc8e7a0d4504be5fd44e80fe935d for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,463 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. completed. 2023-02-11 22:03:16,463 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:16,463 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:16,463 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 22:03:16,463 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. started... 2023-02-11 22:03:16,464 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HRegion(2744): Flushing f4cad0c1194b343e8e4a32ae9e644935 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:16,475 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. completed. 2023-02-11 22:03:16,475 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:16,475 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 22:03:16,487 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. completed. 2023-02-11 22:03:16,487 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:16,487 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 22:03:16,487 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 22:03:16,487 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,487 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-11 22:03:16,487 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,42223,1676152989972' in zk 2023-02-11 22:03:16,492 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,492 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-11 22:03:16,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:16,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:16,493 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:16,493 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-11 22:03:16,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:16,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:16,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 22:03:16,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:16,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:16,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 22:03:16,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,42223,1676152989972': 2023-02-11 22:03:16,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42223,1676152989972' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-11 22:03:16,500 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/.tmp/f1/c7ed72f2ede04f699e2a5e425d4f19ac 2023-02-11 22:03:16,522 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/.tmp/f2/9decfeafd07b418b85357da0d03abce9 2023-02-11 22:03:16,530 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/.tmp/f1/c7ed72f2ede04f699e2a5e425d4f19ac as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1/c7ed72f2ede04f699e2a5e425d4f19ac 2023-02-11 22:03:16,536 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1/c7ed72f2ede04f699e2a5e425d4f19ac, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:16,538 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/.tmp/f2/9decfeafd07b418b85357da0d03abce9 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2/9decfeafd07b418b85357da0d03abce9 2023-02-11 22:03:16,545 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2/9decfeafd07b418b85357da0d03abce9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:16,547 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f4cad0c1194b343e8e4a32ae9e644935 in 83ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:16,547 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f4cad0c1194b343e8e4a32ae9e644935: 2023-02-11 22:03:16,547 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,547 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:16,547 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1/c7ed72f2ede04f699e2a5e425d4f19ac] hfiles 2023-02-11 22:03:16,547 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1/c7ed72f2ede04f699e2a5e425d4f19ac for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,547 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2/9decfeafd07b418b85357da0d03abce9] hfiles 2023-02-11 22:03:16,548 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2/9decfeafd07b418b85357da0d03abce9 for snapshot=testWithMapReduceMultiRegion 2023-02-11 22:03:16,562 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. completed. 2023-02-11 22:03:16,562 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:16,562 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 22:03:16,649 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. completed. 2023-02-11 22:03:16,649 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:16,649 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. completed. 2023-02-11 22:03:16,649 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:16,649 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 22:03:16,649 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 22:03:16,650 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 22:03:16,650 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:16,650 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-11 22:03:16,650 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,34009,1676152989925' in zk 2023-02-11 22:03:16,653 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-11 22:03:16,653 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:16,653 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:16,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:16,653 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-11 22:03:16,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:16,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:16,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:16,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:16,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 22:03:16,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:16,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:16,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 22:03:16,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:16,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,34009,1676152989925': 2023-02-11 22:03:16,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34009,1676152989925' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-11 22:03:16,660 INFO [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-11 22:03:16,660 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:16,660 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:16,660 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-11 22:03:16,660 INFO [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 22:03:16,664 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:16,664 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:16,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:16,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:16,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:16,664 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:16,664 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:16,664 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:16,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:16,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:16,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:16,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:16,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:16,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:16,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:16,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:16,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:16,665 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:16,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:16,666 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:16,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 22:03:16,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:16,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 22:03:16,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:16,669 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:16,669 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:16,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 22:03:16,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:16,684 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:16,684 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:16,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:16,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:16,685 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:16,685 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 22:03:16,685 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,685 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:16,685 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 22:03:16,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:16,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:16,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:16,685 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:16,685 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:16,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:16,685 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:16,685 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-11 22:03:16,686 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:16,686 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:16,686 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 22:03:16,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-11 22:03:16,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:16,686 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 22:03:16,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-11 22:03:16,785 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:16,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 22:03:16,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:16,792 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-11 22:03:16,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-11 22:03:16,862 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-11 22:03:16,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-11 22:03:16,862 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-11 22:03:16,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676152995657Consolidate snapshot: testWithMapReduceMultiRegion at 1676152996686 (+1029 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676152996686Writing data manifest for testWithMapReduceMultiRegion at 1676152996715 (+29 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676152996754 (+39 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676152996862 (+108 ms) 2023-02-11 22:03:16,864 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 22:03:16,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1930 sec 2023-02-11 22:03:17,335 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 22:03:17,398 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-11 22:03:17,400 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-11 22:03:17,792 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:17,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 22:03:17,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 22:03:17,795 INFO [Listener at localhost/34175] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 22:03:17,810 INFO [Listener at localhost/34175] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 22:03:17,822 INFO [Listener at localhost/34175] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 22:03:17,889 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42223] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:17,897 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34009] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:18,033 INFO [Listener at localhost/34175] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 22:03:18,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-11 22:03:18,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-11 22:03:18,052 INFO [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-11 22:03:18,052 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:18,053 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-11 22:03:18,053 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-11 22:03:18,054 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,054 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:18,055 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:18,055 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:18,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:18,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:18,055 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:18,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:18,056 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,056 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:18,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:18,056 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,056 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:18,057 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 22:03:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:18,057 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 22:03:18,058 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 22:03:18,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 22:03:18,063 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 22:03:18,063 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:18,063 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 22:03:18,064 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:18,064 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 22:03:18,064 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 22:03:18,065 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:18,066 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:18,066 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. started... 2023-02-11 22:03:18,066 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. started... 2023-02-11 22:03:18,066 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0519adef6e85fa187149abd26f95f098 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 22:03:18,066 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 070a5c745f9f5c517b1901b17b8947dc 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 22:03:18,071 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:18,072 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 22:03:18,072 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:18,072 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 22:03:18,072 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:18,072 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. started... 2023-02-11 22:03:18,073 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 870d3bbd554356b61360331b0eb3e04a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:18,073 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:18,073 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. started... 2023-02-11 22:03:18,073 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 961f290dab68a52635871a37265197e0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:18,072 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. started... 2023-02-11 22:03:18,076 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5463b0e9cdead8e921a4e0076db0f66c: 2023-02-11 22:03:18,076 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:18,076 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:18,076 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. started... 2023-02-11 22:03:18,076 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bfc034d276e222013aeb52773a06afd6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:18,072 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. started... 2023-02-11 22:03:18,073 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 22:03:18,077 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 22:03:18,077 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 22:03:18,077 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8a388f03d58c0b175fddfdd1441825c7: 2023-02-11 22:03:18,077 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:18,077 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:18,077 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 22:03:18,077 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. started... 2023-02-11 22:03:18,078 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f94672b7a9e77d5e94937bdc8274bd85 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:18,157 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/.tmp/f1/521056934f854226a982a0a4019bd728 2023-02-11 22:03:18,162 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/.tmp/f1/9d2554424fe541808b3980444392b528 2023-02-11 22:03:18,171 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/.tmp/f1/a02cdf45b6b641a198c309cb8b87f3f6 2023-02-11 22:03:18,179 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/.tmp/f1/ea28b0bc541d45abb00d8d391525e3fb 2023-02-11 22:03:18,187 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/.tmp/f1/e2e34d5434db46229b6b6d95063f9158 2023-02-11 22:03:18,199 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/.tmp/f1/f67cb26451f641cc98cc335be171cdd2 2023-02-11 22:03:18,225 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/.tmp/f2/7232174b130344f1917e312d083495f8 2023-02-11 22:03:18,233 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/.tmp/f1/521056934f854226a982a0a4019bd728 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1/521056934f854226a982a0a4019bd728 2023-02-11 22:03:18,240 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1/521056934f854226a982a0a4019bd728, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:18,241 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/.tmp/f2/7232174b130344f1917e312d083495f8 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2/7232174b130344f1917e312d083495f8 2023-02-11 22:03:18,248 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2/7232174b130344f1917e312d083495f8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:18,250 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bfc034d276e222013aeb52773a06afd6 in 174ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:18,250 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bfc034d276e222013aeb52773a06afd6: 2023-02-11 22:03:18,250 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:18,255 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/.tmp/f2/61849e41d654471187f481aca53781cc 2023-02-11 22:03:18,255 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:18,256 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/.tmp/f2/db6f11155163452aa33eefb57450909a 2023-02-11 22:03:18,255 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 22:03:18,256 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. started... 2023-02-11 22:03:18,257 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f4cad0c1194b343e8e4a32ae9e644935 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:18,268 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/.tmp/f2/4d6467acdba44c43a9c56a7f9bb37033 2023-02-11 22:03:18,268 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/.tmp/f2/9955e2c462094d7c9728ec0f1aa6b992 2023-02-11 22:03:18,272 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/.tmp/f1/9d2554424fe541808b3980444392b528 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1/9d2554424fe541808b3980444392b528 2023-02-11 22:03:18,272 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/.tmp/f1/ea28b0bc541d45abb00d8d391525e3fb as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1/ea28b0bc541d45abb00d8d391525e3fb 2023-02-11 22:03:18,273 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/.tmp/f2/37cc686f40cf4fd9b1f237d3007c9680 2023-02-11 22:03:18,282 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/.tmp/f1/f67cb26451f641cc98cc335be171cdd2 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1/f67cb26451f641cc98cc335be171cdd2 2023-02-11 22:03:18,284 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1/9d2554424fe541808b3980444392b528, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 22:03:18,285 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1/ea28b0bc541d45abb00d8d391525e3fb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:18,286 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/.tmp/f2/db6f11155163452aa33eefb57450909a as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2/db6f11155163452aa33eefb57450909a 2023-02-11 22:03:18,287 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/.tmp/f2/61849e41d654471187f481aca53781cc as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2/61849e41d654471187f481aca53781cc 2023-02-11 22:03:18,292 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1/f67cb26451f641cc98cc335be171cdd2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:18,293 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/.tmp/f2/4d6467acdba44c43a9c56a7f9bb37033 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2/4d6467acdba44c43a9c56a7f9bb37033 2023-02-11 22:03:18,306 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/.tmp/f1/a02cdf45b6b641a198c309cb8b87f3f6 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1/a02cdf45b6b641a198c309cb8b87f3f6 2023-02-11 22:03:18,306 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2/61849e41d654471187f481aca53781cc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:18,307 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/.tmp/f1/e2e34d5434db46229b6b6d95063f9158 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1/e2e34d5434db46229b6b6d95063f9158 2023-02-11 22:03:18,308 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 961f290dab68a52635871a37265197e0 in 235ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:18,308 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2/db6f11155163452aa33eefb57450909a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 22:03:18,309 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2/4d6467acdba44c43a9c56a7f9bb37033, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:18,308 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 961f290dab68a52635871a37265197e0: 2023-02-11 22:03:18,309 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:18,309 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 22:03:18,310 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f94672b7a9e77d5e94937bdc8274bd85 in 232ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:18,310 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f94672b7a9e77d5e94937bdc8274bd85: 2023-02-11 22:03:18,310 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:18,310 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 0519adef6e85fa187149abd26f95f098 in 244ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:18,310 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 22:03:18,310 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:18,310 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. started... 2023-02-11 22:03:18,311 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3be2765ad731f78cd1d3670b14ea6f94 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:18,311 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/.tmp/f1/0d85de40e16f44a1aa4f12055f6d6c53 2023-02-11 22:03:18,310 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0519adef6e85fa187149abd26f95f098: 2023-02-11 22:03:18,311 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:18,312 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 22:03:18,318 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1/e2e34d5434db46229b6b6d95063f9158, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 22:03:18,319 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/.tmp/f2/9955e2c462094d7c9728ec0f1aa6b992 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2/9955e2c462094d7c9728ec0f1aa6b992 2023-02-11 22:03:18,321 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1/a02cdf45b6b641a198c309cb8b87f3f6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:18,322 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/.tmp/f2/37cc686f40cf4fd9b1f237d3007c9680 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2/37cc686f40cf4fd9b1f237d3007c9680 2023-02-11 22:03:18,327 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2/9955e2c462094d7c9728ec0f1aa6b992, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 22:03:18,329 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2/37cc686f40cf4fd9b1f237d3007c9680, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:18,329 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 070a5c745f9f5c517b1901b17b8947dc in 263ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:18,329 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 070a5c745f9f5c517b1901b17b8947dc: 2023-02-11 22:03:18,329 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:18,330 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 22:03:18,330 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 870d3bbd554356b61360331b0eb3e04a in 258ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:18,330 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 870d3bbd554356b61360331b0eb3e04a: 2023-02-11 22:03:18,330 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:18,330 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 22:03:18,339 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/.tmp/f1/bed88230285f42bbae09aa46db879fcb 2023-02-11 22:03:18,342 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/.tmp/f2/3473e715a71342ad98332a823b9a21b4 2023-02-11 22:03:18,350 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/.tmp/f1/0d85de40e16f44a1aa4f12055f6d6c53 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1/0d85de40e16f44a1aa4f12055f6d6c53 2023-02-11 22:03:18,356 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1/0d85de40e16f44a1aa4f12055f6d6c53, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:18,357 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/.tmp/f2/3473e715a71342ad98332a823b9a21b4 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2/3473e715a71342ad98332a823b9a21b4 2023-02-11 22:03:18,359 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/.tmp/f2/98623d2648d4439596b9e4d82a5b3f57 2023-02-11 22:03:18,364 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2/3473e715a71342ad98332a823b9a21b4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:18,365 INFO [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f4cad0c1194b343e8e4a32ae9e644935 in 108ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:18,365 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f4cad0c1194b343e8e4a32ae9e644935: 2023-02-11 22:03:18,365 DEBUG [rs(jenkins-hbase9.apache.org,34009,1676152989925)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:18,365 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 22:03:18,365 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 22:03:18,365 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,365 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 22:03:18,365 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34009,1676152989925' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 22:03:18,366 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/.tmp/f1/bed88230285f42bbae09aa46db879fcb as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1/bed88230285f42bbae09aa46db879fcb 2023-02-11 22:03:18,368 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,368 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:18,368 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,368 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:18,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34009,1676152989925' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 22:03:18,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5faddf99[Count = 1] remaining members to acquire global barrier 2023-02-11 22:03:18,372 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1/bed88230285f42bbae09aa46db879fcb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:18,373 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/.tmp/f2/98623d2648d4439596b9e4d82a5b3f57 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2/98623d2648d4439596b9e4d82a5b3f57 2023-02-11 22:03:18,379 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2/98623d2648d4439596b9e4d82a5b3f57, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:18,379 INFO [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3be2765ad731f78cd1d3670b14ea6f94 in 68ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:18,380 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3be2765ad731f78cd1d3670b14ea6f94: 2023-02-11 22:03:18,380 DEBUG [rs(jenkins-hbase9.apache.org,42223,1676152989972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:18,380 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 22:03:18,380 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 22:03:18,380 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,380 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 22:03:18,380 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42223,1676152989972' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 22:03:18,381 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,381 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:18,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:18,382 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,382 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:18,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:18,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:18,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:18,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:18,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42223,1676152989972' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 22:03:18,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5faddf99[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:18,384 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-11 22:03:18,384 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,387 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,387 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,388 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,388 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 22:03:18,388 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 22:03:18,388 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 22:03:18,388 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 22:03:18,388 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,42223,1676152989972' in zk 2023-02-11 22:03:18,388 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,388 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:18,388 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,34009,1676152989925' in zk 2023-02-11 22:03:18,390 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,390 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 22:03:18,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:18,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:18,390 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:18,390 DEBUG [member: 'jenkins-hbase9.apache.org,42223,1676152989972' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 22:03:18,391 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,391 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 22:03:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:18,391 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:18,391 DEBUG [member: 'jenkins-hbase9.apache.org,34009,1676152989925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 22:03:18,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,42223,1676152989972': 2023-02-11 22:03:18,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42223,1676152989972' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-11 22:03:18,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:18,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:18,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:18,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:18,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:18,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:18,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:18,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,34009,1676152989925': 2023-02-11 22:03:18,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34009,1676152989925' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-11 22:03:18,399 INFO [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-11 22:03:18,399 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:18,399 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:18,399 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-11 22:03:18,399 INFO [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 22:03:18,401 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,401 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:18,401 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:18,401 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,402 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:18,402 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:18,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:18,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:18,403 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:18,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:18,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,405 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:18,406 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:18,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,412 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,412 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:18,412 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:18,412 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:18,412 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:18,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-11 22:03:18,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 22:03:18,412 DEBUG [(jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:18,412 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:18,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:18,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:18,412 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:18,413 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:18,413 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:18,413 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,413 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:18,413 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:18,413 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:18,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:18,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:18,415 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:18,415 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 22:03:18,515 DEBUG [Listener at localhost/34175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 22:03:18,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 22:03:18,620 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/hadoop-5936589563791546371.jar 2023-02-11 22:03:18,638 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676152995590 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:18,639 DEBUG [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce 2023-02-11 22:03:18,640 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(239): region to add: 0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:18,640 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(239): region to add: 870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:18,640 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(239): region to add: 8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:18,640 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(239): region to add: 070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:18,640 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(239): region to add: 5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:18,640 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(239): region to add: 961f290dab68a52635871a37265197e0 2023-02-11 22:03:18,640 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(239): region to add: bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:18,640 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(239): region to add: f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:18,640 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(239): region to add: f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:18,640 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(239): region to add: 3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:18,641 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(585): clone region=0519adef6e85fa187149abd26f95f098 as 0519adef6e85fa187149abd26f95f098 in snapshot testWithMapReduceMultiRegion 2023-02-11 22:03:18,641 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(585): clone region=870d3bbd554356b61360331b0eb3e04a as 870d3bbd554356b61360331b0eb3e04a in snapshot testWithMapReduceMultiRegion 2023-02-11 22:03:18,641 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(585): clone region=8a388f03d58c0b175fddfdd1441825c7 as 8a388f03d58c0b175fddfdd1441825c7 in snapshot testWithMapReduceMultiRegion 2023-02-11 22:03:18,641 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(585): clone region=070a5c745f9f5c517b1901b17b8947dc as 070a5c745f9f5c517b1901b17b8947dc in snapshot testWithMapReduceMultiRegion 2023-02-11 22:03:18,641 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(585): clone region=5463b0e9cdead8e921a4e0076db0f66c as 5463b0e9cdead8e921a4e0076db0f66c in snapshot testWithMapReduceMultiRegion 2023-02-11 22:03:18,641 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(585): clone region=961f290dab68a52635871a37265197e0 as 961f290dab68a52635871a37265197e0 in snapshot testWithMapReduceMultiRegion 2023-02-11 22:03:18,641 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(585): clone region=bfc034d276e222013aeb52773a06afd6 as bfc034d276e222013aeb52773a06afd6 in snapshot testWithMapReduceMultiRegion 2023-02-11 22:03:18,641 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(585): clone region=f94672b7a9e77d5e94937bdc8274bd85 as f94672b7a9e77d5e94937bdc8274bd85 in snapshot testWithMapReduceMultiRegion 2023-02-11 22:03:18,641 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(585): clone region=f4cad0c1194b343e8e4a32ae9e644935 as f4cad0c1194b343e8e4a32ae9e644935 in snapshot testWithMapReduceMultiRegion 2023-02-11 22:03:18,641 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(585): clone region=3be2765ad731f78cd1d3670b14ea6f94 as 3be2765ad731f78cd1d3670b14ea6f94 in snapshot testWithMapReduceMultiRegion 2023-02-11 22:03:18,655 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => f94672b7a9e77d5e94937bdc8274bd85, NAME => 'testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb 2023-02-11 22:03:18,655 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => bfc034d276e222013aeb52773a06afd6, NAME => 'testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb 2023-02-11 22:03:18,655 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 961f290dab68a52635871a37265197e0, NAME => 'testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb 2023-02-11 22:03:18,656 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8a388f03d58c0b175fddfdd1441825c7, NAME => 'testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb 2023-02-11 22:03:18,656 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 5463b0e9cdead8e921a4e0076db0f66c, NAME => 'testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb 2023-02-11 22:03:18,656 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 870d3bbd554356b61360331b0eb3e04a, NAME => 'testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb 2023-02-11 22:03:18,656 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 070a5c745f9f5c517b1901b17b8947dc, NAME => 'testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb 2023-02-11 22:03:18,657 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0519adef6e85fa187149abd26f95f098, NAME => 'testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb 2023-02-11 22:03:18,697 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:18,697 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 8a388f03d58c0b175fddfdd1441825c7, disabling compactions & flushes 2023-02-11 22:03:18,697 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:18,697 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:18,697 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. after waiting 0 ms 2023-02-11 22:03:18,697 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:18,698 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:18,698 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 8a388f03d58c0b175fddfdd1441825c7: Waiting for close lock at 1676152998697Disabling compacts and flushes for region at 1676152998697Disabling writes for close at 1676152998697Writing region close event to WAL at 1676152998698 (+1 ms)Closed at 1676152998698 2023-02-11 22:03:18,698 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => f4cad0c1194b343e8e4a32ae9e644935, NAME => 'testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb 2023-02-11 22:03:18,707 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:18,707 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:18,707 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0e9c2fd88888488d8c191f2c779f7fc3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,707 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7e0f32ccc0d34ee9a3adb96c81ea401a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,711 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:18,711 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9b948254fafa442d8746b4e4eaaa983f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,723 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:18,723 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4e64ec6794d5407ea2f462d346a9a4b5 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,723 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3ab65fd16f7e471f8385886425111068 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,724 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1a791654312e47d49ac4ca5b516e3295 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,731 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e0166dc26b6740368626c2c227790adc from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,747 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 870d3bbd554356b61360331b0eb3e04a, disabling compactions & flushes 2023-02-11 22:03:18,747 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:18,747 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:18,747 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. after waiting 0 ms 2023-02-11 22:03:18,747 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:18,747 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:18,747 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 870d3bbd554356b61360331b0eb3e04a: Waiting for close lock at 1676152998747Disabling compacts and flushes for region at 1676152998747Disabling writes for close at 1676152998747Writing region close event to WAL at 1676152998747Closed at 1676152998747 2023-02-11 22:03:18,749 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3be2765ad731f78cd1d3670b14ea6f94, NAME => 'testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb 2023-02-11 22:03:18,750 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:18,750 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 5463b0e9cdead8e921a4e0076db0f66c, disabling compactions & flushes 2023-02-11 22:03:18,750 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:18,750 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:18,751 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. after waiting 1 ms 2023-02-11 22:03:18,751 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:18,751 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:18,751 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 5463b0e9cdead8e921a4e0076db0f66c: Waiting for close lock at 1676152998750Disabling compacts and flushes for region at 1676152998750Disabling writes for close at 1676152998751 (+1 ms)Writing region close event to WAL at 1676152998751Closed at 1676152998751 2023-02-11 22:03:18,752 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9d675feb919d4c3b958796ef40a222a4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,753 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing bfc034d276e222013aeb52773a06afd6, disabling compactions & flushes 2023-02-11 22:03:18,753 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:18,753 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:18,754 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. after waiting 0 ms 2023-02-11 22:03:18,754 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:18,754 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:18,754 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for bfc034d276e222013aeb52773a06afd6: Waiting for close lock at 1676152998753Disabling compacts and flushes for region at 1676152998753Disabling writes for close at 1676152998754 (+1 ms)Writing region close event to WAL at 1676152998754Closed at 1676152998754 2023-02-11 22:03:18,755 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:18,755 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c7ed72f2ede04f699e2a5e425d4f19ac from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,756 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:18,756 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e693e0b9be4e48e59e5f0a16bc5b8540 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,757 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 961f290dab68a52635871a37265197e0, disabling compactions & flushes 2023-02-11 22:03:18,758 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:18,758 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:18,758 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. after waiting 0 ms 2023-02-11 22:03:18,758 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:18,758 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:18,758 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 961f290dab68a52635871a37265197e0: Waiting for close lock at 1676152998757Disabling compacts and flushes for region at 1676152998757Disabling writes for close at 1676152998758 (+1 ms)Writing region close event to WAL at 1676152998758Closed at 1676152998758 2023-02-11 22:03:18,759 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 070a5c745f9f5c517b1901b17b8947dc, disabling compactions & flushes 2023-02-11 22:03:18,759 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:18,759 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:18,759 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. after waiting 0 ms 2023-02-11 22:03:18,759 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:18,759 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e20b34977f0143cb9d2efe553b372a37 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,759 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:18,759 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:18,759 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 070a5c745f9f5c517b1901b17b8947dc: Waiting for close lock at 1676152998759Disabling compacts and flushes for region at 1676152998759Disabling writes for close at 1676152998759Writing region close event to WAL at 1676152998759Closed at 1676152998759 2023-02-11 22:03:18,766 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0a627474152241bb9fb22924f0b4db22 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,767 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3e3987dbe22a4802a7ae4861691f0517 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,768 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9decfeafd07b418b85357da0d03abce9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,775 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:18,775 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e4e34cb35ca542c2b5f1c15215ecb517 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,779 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing f4cad0c1194b343e8e4a32ae9e644935, disabling compactions & flushes 2023-02-11 22:03:18,779 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:18,779 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:18,779 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. after waiting 0 ms 2023-02-11 22:03:18,779 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:18,779 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:18,779 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for f4cad0c1194b343e8e4a32ae9e644935: Waiting for close lock at 1676152998779Disabling compacts and flushes for region at 1676152998779Disabling writes for close at 1676152998779Writing region close event to WAL at 1676152998779Closed at 1676152998779 2023-02-11 22:03:18,780 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing f94672b7a9e77d5e94937bdc8274bd85, disabling compactions & flushes 2023-02-11 22:03:18,780 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:18,780 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 518bcc8e7a0d4504be5fd44e80fe935d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 22:03:18,780 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0519adef6e85fa187149abd26f95f098, disabling compactions & flushes 2023-02-11 22:03:18,780 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:18,780 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:18,780 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. after waiting 0 ms 2023-02-11 22:03:18,780 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:18,780 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:18,780 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. after waiting 0 ms 2023-02-11 22:03:18,780 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:18,780 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:18,780 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:18,780 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for f94672b7a9e77d5e94937bdc8274bd85: Waiting for close lock at 1676152998780Disabling compacts and flushes for region at 1676152998780Disabling writes for close at 1676152998780Writing region close event to WAL at 1676152998780Closed at 1676152998780 2023-02-11 22:03:18,780 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0519adef6e85fa187149abd26f95f098: Waiting for close lock at 1676152998780Disabling compacts and flushes for region at 1676152998780Disabling writes for close at 1676152998780Writing region close event to WAL at 1676152998780Closed at 1676152998780 2023-02-11 22:03:18,782 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 3be2765ad731f78cd1d3670b14ea6f94, disabling compactions & flushes 2023-02-11 22:03:18,782 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:18,782 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:18,782 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. after waiting 0 ms 2023-02-11 22:03:18,783 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:18,783 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:18,783 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 3be2765ad731f78cd1d3670b14ea6f94: Waiting for close lock at 1676152998782Disabling compacts and flushes for region at 1676152998782Disabling writes for close at 1676152998783 (+1 ms)Writing region close event to WAL at 1676152998783Closed at 1676152998783 2023-02-11 22:03:18,783 INFO [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676152995590 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:18,783 DEBUG [Listener at localhost/34175] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb 2023-02-11 22:03:18,783 DEBUG [Listener at localhost/34175] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb 2023-02-11 22:03:18,784 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-data/ 2023-02-11 22:03:18,785 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |----default/ 2023-02-11 22:03:18,785 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-11 22:03:18,786 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |----------0519adef6e85fa187149abd26f95f098/ 2023-02-11 22:03:18,786 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:18,786 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:18,787 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=0519adef6e85fa187149abd26f95f098-e693e0b9be4e48e59e5f0a16bc5b8540 2023-02-11 22:03:18,787 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:18,787 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=0519adef6e85fa187149abd26f95f098-0a627474152241bb9fb22924f0b4db22 2023-02-11 22:03:18,787 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |----------070a5c745f9f5c517b1901b17b8947dc/ 2023-02-11 22:03:18,788 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:18,788 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:18,788 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=070a5c745f9f5c517b1901b17b8947dc-3ab65fd16f7e471f8385886425111068 2023-02-11 22:03:18,788 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:18,789 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=070a5c745f9f5c517b1901b17b8947dc-9d675feb919d4c3b958796ef40a222a4 2023-02-11 22:03:18,789 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |----------3be2765ad731f78cd1d3670b14ea6f94/ 2023-02-11 22:03:18,789 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:18,789 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:18,790 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=3be2765ad731f78cd1d3670b14ea6f94-e4e34cb35ca542c2b5f1c15215ecb517 2023-02-11 22:03:18,790 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:18,790 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=3be2765ad731f78cd1d3670b14ea6f94-518bcc8e7a0d4504be5fd44e80fe935d 2023-02-11 22:03:18,791 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |----------5463b0e9cdead8e921a4e0076db0f66c/ 2023-02-11 22:03:18,791 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:18,791 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |----------870d3bbd554356b61360331b0eb3e04a/ 2023-02-11 22:03:18,792 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:18,792 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:18,792 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=870d3bbd554356b61360331b0eb3e04a-0e9c2fd88888488d8c191f2c779f7fc3 2023-02-11 22:03:18,792 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:18,793 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=870d3bbd554356b61360331b0eb3e04a-4e64ec6794d5407ea2f462d346a9a4b5 2023-02-11 22:03:18,793 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |----------8a388f03d58c0b175fddfdd1441825c7/ 2023-02-11 22:03:18,793 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:18,793 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |----------961f290dab68a52635871a37265197e0/ 2023-02-11 22:03:18,794 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:18,794 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:18,794 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=961f290dab68a52635871a37265197e0-7e0f32ccc0d34ee9a3adb96c81ea401a 2023-02-11 22:03:18,794 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:18,795 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=961f290dab68a52635871a37265197e0-e0166dc26b6740368626c2c227790adc 2023-02-11 22:03:18,795 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |----------bfc034d276e222013aeb52773a06afd6/ 2023-02-11 22:03:18,795 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:18,795 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:18,796 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=bfc034d276e222013aeb52773a06afd6-9b948254fafa442d8746b4e4eaaa983f 2023-02-11 22:03:18,796 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:18,796 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=bfc034d276e222013aeb52773a06afd6-1a791654312e47d49ac4ca5b516e3295 2023-02-11 22:03:18,796 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |----------f4cad0c1194b343e8e4a32ae9e644935/ 2023-02-11 22:03:18,797 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:18,797 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:18,798 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=f4cad0c1194b343e8e4a32ae9e644935-c7ed72f2ede04f699e2a5e425d4f19ac 2023-02-11 22:03:18,798 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:18,798 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=f4cad0c1194b343e8e4a32ae9e644935-9decfeafd07b418b85357da0d03abce9 2023-02-11 22:03:18,798 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |----------f94672b7a9e77d5e94937bdc8274bd85/ 2023-02-11 22:03:18,799 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:18,799 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:18,799 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=f94672b7a9e77d5e94937bdc8274bd85-e20b34977f0143cb9d2efe553b372a37 2023-02-11 22:03:18,800 DEBUG [Listener at localhost/34175] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:18,800 DEBUG [Listener at localhost/34175] util.CommonFSUtils(702): |----------------testWithMapReduce=f94672b7a9e77d5e94937bdc8274bd85-3e3987dbe22a4802a7ae4861691f0517 2023-02-11 22:03:18,810 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,811 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,812 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,812 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,813 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,813 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,814 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,865 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 22:03:18,866 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-11 22:03:18,889 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/hadoop-3809491009299762214.jar 2023-02-11 22:03:18,890 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,891 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,891 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,892 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,892 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,892 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,893 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-11 22:03:18,893 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-11 22:03:18,894 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-11 22:03:18,894 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-11 22:03:18,895 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-11 22:03:18,895 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-11 22:03:18,896 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-11 22:03:18,896 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-11 22:03:18,897 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-11 22:03:18,897 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-11 22:03:18,902 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:18,903 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 22:03:18,903 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 22:03:18,904 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 22:03:18,904 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 22:03:18,973 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/hadoop-3275824490379917743.jar 2023-02-11 22:03:18,974 DEBUG [Listener at localhost/34175] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 22:03:19,029 WARN [Listener at localhost/34175] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-11 22:03:19,089 INFO [Listener at localhost/34175] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 22:03:19,451 WARN [Listener at localhost/34175] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/mapreduce.cluster.local.dir/1676152999368/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-11 22:03:19,451 WARN [Listener at localhost/34175] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/mapreduce.cluster.local.dir/1676152999368/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-11 22:03:19,589 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:19,589 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:19,591 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:19,593 INFO [StoreOpener-0519adef6e85fa187149abd26f95f098-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:19,594 DEBUG [StoreOpener-0519adef6e85fa187149abd26f95f098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1 2023-02-11 22:03:19,595 INFO [StoreOpener-0519adef6e85fa187149abd26f95f098-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0519adef6e85fa187149abd26f95f098 columnFamilyName f1 2023-02-11 22:03:19,604 DEBUG [StoreOpener-0519adef6e85fa187149abd26f95f098-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1/testWithMapReduce=0519adef6e85fa187149abd26f95f098-e693e0b9be4e48e59e5f0a16bc5b8540 2023-02-11 22:03:19,604 INFO [StoreOpener-0519adef6e85fa187149abd26f95f098-1] regionserver.HStore(310): Store=0519adef6e85fa187149abd26f95f098/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:19,604 INFO [StoreOpener-0519adef6e85fa187149abd26f95f098-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:19,605 DEBUG [StoreOpener-0519adef6e85fa187149abd26f95f098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2 2023-02-11 22:03:19,606 INFO [StoreOpener-0519adef6e85fa187149abd26f95f098-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0519adef6e85fa187149abd26f95f098 columnFamilyName f2 2023-02-11 22:03:19,611 DEBUG [StoreOpener-0519adef6e85fa187149abd26f95f098-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2/testWithMapReduce=0519adef6e85fa187149abd26f95f098-0a627474152241bb9fb22924f0b4db22 2023-02-11 22:03:19,612 INFO [StoreOpener-0519adef6e85fa187149abd26f95f098-1] regionserver.HStore(310): Store=0519adef6e85fa187149abd26f95f098/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:19,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:19,612 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0519adef6e85fa187149abd26f95f098; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73767754, jitterRate=0.09922519326210022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:19,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0519adef6e85fa187149abd26f95f098: Writing region info on filesystem at 1676152999591Initializing all the Stores at 1676152999592 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152999592Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152999593 (+1 ms)Region opened successfully at 1676152999612 (+19 ms) 2023-02-11 22:03:19,789 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0519adef6e85fa187149abd26f95f098, disabling compactions & flushes 2023-02-11 22:03:19,789 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:19,789 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:19,789 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. after waiting 0 ms 2023-02-11 22:03:19,789 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:19,793 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:19,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0519adef6e85fa187149abd26f95f098: Waiting for close lock at 1676152999789Disabling compacts and flushes for region at 1676152999789Disabling writes for close at 1676152999789Writing region close event to WAL at 1676152999793 (+4 ms)Closed at 1676152999793 2023-02-11 22:03:19,809 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:19,809 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:19,810 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:19,813 INFO [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:19,814 DEBUG [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1 2023-02-11 22:03:19,815 INFO [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 070a5c745f9f5c517b1901b17b8947dc columnFamilyName f1 2023-02-11 22:03:19,822 DEBUG [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1/testWithMapReduce=070a5c745f9f5c517b1901b17b8947dc-3ab65fd16f7e471f8385886425111068 2023-02-11 22:03:19,822 INFO [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] regionserver.HStore(310): Store=070a5c745f9f5c517b1901b17b8947dc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:19,822 INFO [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:19,823 DEBUG [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2 2023-02-11 22:03:19,824 INFO [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 070a5c745f9f5c517b1901b17b8947dc columnFamilyName f2 2023-02-11 22:03:19,829 DEBUG [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2/testWithMapReduce=070a5c745f9f5c517b1901b17b8947dc-9d675feb919d4c3b958796ef40a222a4 2023-02-11 22:03:19,830 INFO [StoreOpener-070a5c745f9f5c517b1901b17b8947dc-1] regionserver.HStore(310): Store=070a5c745f9f5c517b1901b17b8947dc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:19,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:19,831 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 070a5c745f9f5c517b1901b17b8947dc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73302267, jitterRate=0.09228889644145966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:19,831 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 070a5c745f9f5c517b1901b17b8947dc: Writing region info on filesystem at 1676152999811Initializing all the Stores at 1676152999812 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152999812Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152999812Region opened successfully at 1676152999831 (+19 ms) 2023-02-11 22:03:19,876 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 070a5c745f9f5c517b1901b17b8947dc, disabling compactions & flushes 2023-02-11 22:03:19,876 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:19,876 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:19,876 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. after waiting 0 ms 2023-02-11 22:03:19,876 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:19,880 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:19,880 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 070a5c745f9f5c517b1901b17b8947dc: Waiting for close lock at 1676152999876Disabling compacts and flushes for region at 1676152999876Disabling writes for close at 1676152999876Writing region close event to WAL at 1676152999880 (+4 ms)Closed at 1676152999880 2023-02-11 22:03:19,886 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:19,886 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:19,887 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:19,891 INFO [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:19,892 DEBUG [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1 2023-02-11 22:03:19,893 INFO [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 870d3bbd554356b61360331b0eb3e04a columnFamilyName f1 2023-02-11 22:03:19,900 DEBUG [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1/testWithMapReduce=870d3bbd554356b61360331b0eb3e04a-0e9c2fd88888488d8c191f2c779f7fc3 2023-02-11 22:03:19,900 INFO [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] regionserver.HStore(310): Store=870d3bbd554356b61360331b0eb3e04a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:19,900 INFO [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:19,901 DEBUG [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2 2023-02-11 22:03:19,902 INFO [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 870d3bbd554356b61360331b0eb3e04a columnFamilyName f2 2023-02-11 22:03:19,909 DEBUG [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2/testWithMapReduce=870d3bbd554356b61360331b0eb3e04a-4e64ec6794d5407ea2f462d346a9a4b5 2023-02-11 22:03:19,909 INFO [StoreOpener-870d3bbd554356b61360331b0eb3e04a-1] regionserver.HStore(310): Store=870d3bbd554356b61360331b0eb3e04a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:19,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:19,909 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 870d3bbd554356b61360331b0eb3e04a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74038714, jitterRate=0.10326281189918518}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:19,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 870d3bbd554356b61360331b0eb3e04a: Writing region info on filesystem at 1676152999887Initializing all the Stores at 1676152999889 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152999889Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152999890 (+1 ms)Region opened successfully at 1676152999909 (+19 ms) 2023-02-11 22:03:19,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 870d3bbd554356b61360331b0eb3e04a, disabling compactions & flushes 2023-02-11 22:03:19,947 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:19,947 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:19,947 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. after waiting 0 ms 2023-02-11 22:03:19,947 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:19,952 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:19,952 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 870d3bbd554356b61360331b0eb3e04a: Waiting for close lock at 1676152999946Disabling compacts and flushes for region at 1676152999946Disabling writes for close at 1676152999947 (+1 ms)Writing region close event to WAL at 1676152999952 (+5 ms)Closed at 1676152999952 2023-02-11 22:03:19,957 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:19,958 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:19,963 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:19,967 INFO [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:19,969 DEBUG [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/f1 2023-02-11 22:03:19,970 INFO [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5463b0e9cdead8e921a4e0076db0f66c columnFamilyName f1 2023-02-11 22:03:19,971 INFO [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] regionserver.HStore(310): Store=5463b0e9cdead8e921a4e0076db0f66c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:19,971 INFO [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:19,972 DEBUG [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/f2 2023-02-11 22:03:19,973 INFO [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5463b0e9cdead8e921a4e0076db0f66c columnFamilyName f2 2023-02-11 22:03:19,973 INFO [StoreOpener-5463b0e9cdead8e921a4e0076db0f66c-1] regionserver.HStore(310): Store=5463b0e9cdead8e921a4e0076db0f66c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:19,974 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:19,974 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5463b0e9cdead8e921a4e0076db0f66c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67316048, jitterRate=0.003087282180786133}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:19,974 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5463b0e9cdead8e921a4e0076db0f66c: Writing region info on filesystem at 1676152999963Initializing all the Stores at 1676152999964 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152999964Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676152999967 (+3 ms)Region opened successfully at 1676152999974 (+7 ms) 2023-02-11 22:03:20,025 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5463b0e9cdead8e921a4e0076db0f66c, disabling compactions & flushes 2023-02-11 22:03:20,026 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:20,026 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:20,026 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. after waiting 0 ms 2023-02-11 22:03:20,026 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:20,026 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:20,026 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5463b0e9cdead8e921a4e0076db0f66c: Waiting for close lock at 1676153000025Disabling compacts and flushes for region at 1676153000025Disabling writes for close at 1676153000026 (+1 ms)Writing region close event to WAL at 1676153000026Closed at 1676153000026 2023-02-11 22:03:20,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:20,031 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:20,032 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:20,033 INFO [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:20,035 DEBUG [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1 2023-02-11 22:03:20,035 INFO [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3be2765ad731f78cd1d3670b14ea6f94 columnFamilyName f1 2023-02-11 22:03:20,041 DEBUG [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1/testWithMapReduce=3be2765ad731f78cd1d3670b14ea6f94-e4e34cb35ca542c2b5f1c15215ecb517 2023-02-11 22:03:20,041 INFO [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] regionserver.HStore(310): Store=3be2765ad731f78cd1d3670b14ea6f94/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:20,041 INFO [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:20,042 DEBUG [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2 2023-02-11 22:03:20,043 INFO [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3be2765ad731f78cd1d3670b14ea6f94 columnFamilyName f2 2023-02-11 22:03:20,049 DEBUG [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2/testWithMapReduce=3be2765ad731f78cd1d3670b14ea6f94-518bcc8e7a0d4504be5fd44e80fe935d 2023-02-11 22:03:20,050 INFO [StoreOpener-3be2765ad731f78cd1d3670b14ea6f94-1] regionserver.HStore(310): Store=3be2765ad731f78cd1d3670b14ea6f94/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:20,050 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:20,050 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3be2765ad731f78cd1d3670b14ea6f94; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61135600, jitterRate=-0.08900856971740723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:20,050 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3be2765ad731f78cd1d3670b14ea6f94: Writing region info on filesystem at 1676153000032Initializing all the Stores at 1676153000033 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153000033Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153000033Region opened successfully at 1676153000050 (+17 ms) 2023-02-11 22:03:20,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3be2765ad731f78cd1d3670b14ea6f94, disabling compactions & flushes 2023-02-11 22:03:20,090 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:20,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:20,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. after waiting 0 ms 2023-02-11 22:03:20,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:20,095 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:20,095 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3be2765ad731f78cd1d3670b14ea6f94: Waiting for close lock at 1676153000089Disabling compacts and flushes for region at 1676153000089Disabling writes for close at 1676153000090 (+1 ms)Writing region close event to WAL at 1676153000095 (+5 ms)Closed at 1676153000095 2023-02-11 22:03:20,101 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:20,101 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:20,103 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:20,107 INFO [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:20,109 DEBUG [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/f1 2023-02-11 22:03:20,109 INFO [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a388f03d58c0b175fddfdd1441825c7 columnFamilyName f1 2023-02-11 22:03:20,110 INFO [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] regionserver.HStore(310): Store=8a388f03d58c0b175fddfdd1441825c7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:20,110 INFO [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:20,111 DEBUG [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/f2 2023-02-11 22:03:20,112 INFO [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a388f03d58c0b175fddfdd1441825c7 columnFamilyName f2 2023-02-11 22:03:20,112 INFO [StoreOpener-8a388f03d58c0b175fddfdd1441825c7-1] regionserver.HStore(310): Store=8a388f03d58c0b175fddfdd1441825c7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:20,113 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:20,113 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8a388f03d58c0b175fddfdd1441825c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64720665, jitterRate=-0.03558693826198578}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:20,113 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8a388f03d58c0b175fddfdd1441825c7: Writing region info on filesystem at 1676153000104Initializing all the Stores at 1676153000104Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153000105 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153000107 (+2 ms)Region opened successfully at 1676153000113 (+6 ms) 2023-02-11 22:03:20,132 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8a388f03d58c0b175fddfdd1441825c7, disabling compactions & flushes 2023-02-11 22:03:20,133 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:20,133 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:20,133 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. after waiting 0 ms 2023-02-11 22:03:20,133 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:20,133 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:20,133 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8a388f03d58c0b175fddfdd1441825c7: Waiting for close lock at 1676153000132Disabling compacts and flushes for region at 1676153000132Disabling writes for close at 1676153000133 (+1 ms)Writing region close event to WAL at 1676153000133Closed at 1676153000133 2023-02-11 22:03:20,139 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:20,139 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:20,143 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:20,145 INFO [StoreOpener-961f290dab68a52635871a37265197e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 961f290dab68a52635871a37265197e0 2023-02-11 22:03:20,146 DEBUG [StoreOpener-961f290dab68a52635871a37265197e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1 2023-02-11 22:03:20,146 INFO [StoreOpener-961f290dab68a52635871a37265197e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 961f290dab68a52635871a37265197e0 columnFamilyName f1 2023-02-11 22:03:20,153 DEBUG [StoreOpener-961f290dab68a52635871a37265197e0-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1/testWithMapReduce=961f290dab68a52635871a37265197e0-7e0f32ccc0d34ee9a3adb96c81ea401a 2023-02-11 22:03:20,153 INFO [StoreOpener-961f290dab68a52635871a37265197e0-1] regionserver.HStore(310): Store=961f290dab68a52635871a37265197e0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:20,153 INFO [StoreOpener-961f290dab68a52635871a37265197e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 961f290dab68a52635871a37265197e0 2023-02-11 22:03:20,154 DEBUG [StoreOpener-961f290dab68a52635871a37265197e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2 2023-02-11 22:03:20,155 INFO [StoreOpener-961f290dab68a52635871a37265197e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 961f290dab68a52635871a37265197e0 columnFamilyName f2 2023-02-11 22:03:20,161 DEBUG [StoreOpener-961f290dab68a52635871a37265197e0-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2/testWithMapReduce=961f290dab68a52635871a37265197e0-e0166dc26b6740368626c2c227790adc 2023-02-11 22:03:20,161 INFO [StoreOpener-961f290dab68a52635871a37265197e0-1] regionserver.HStore(310): Store=961f290dab68a52635871a37265197e0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:20,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:20,161 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 961f290dab68a52635871a37265197e0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71350508, jitterRate=0.06320542097091675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:20,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 961f290dab68a52635871a37265197e0: Writing region info on filesystem at 1676153000143Initializing all the Stores at 1676153000144 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153000144Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153000144Region opened successfully at 1676153000161 (+17 ms) 2023-02-11 22:03:20,200 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 961f290dab68a52635871a37265197e0, disabling compactions & flushes 2023-02-11 22:03:20,200 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:20,200 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:20,200 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. after waiting 0 ms 2023-02-11 22:03:20,201 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:20,204 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:20,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 961f290dab68a52635871a37265197e0: Waiting for close lock at 1676153000200Disabling compacts and flushes for region at 1676153000200Disabling writes for close at 1676153000201 (+1 ms)Writing region close event to WAL at 1676153000204 (+3 ms)Closed at 1676153000204 2023-02-11 22:03:20,209 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:20,210 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:20,212 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:20,214 INFO [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:20,216 DEBUG [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1 2023-02-11 22:03:20,216 INFO [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfc034d276e222013aeb52773a06afd6 columnFamilyName f1 2023-02-11 22:03:20,224 DEBUG [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1/testWithMapReduce=bfc034d276e222013aeb52773a06afd6-9b948254fafa442d8746b4e4eaaa983f 2023-02-11 22:03:20,225 INFO [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] regionserver.HStore(310): Store=bfc034d276e222013aeb52773a06afd6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:20,225 INFO [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:20,226 DEBUG [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2 2023-02-11 22:03:20,226 INFO [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfc034d276e222013aeb52773a06afd6 columnFamilyName f2 2023-02-11 22:03:20,237 DEBUG [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2/testWithMapReduce=bfc034d276e222013aeb52773a06afd6-1a791654312e47d49ac4ca5b516e3295 2023-02-11 22:03:20,237 INFO [StoreOpener-bfc034d276e222013aeb52773a06afd6-1] regionserver.HStore(310): Store=bfc034d276e222013aeb52773a06afd6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:20,237 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:20,238 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bfc034d276e222013aeb52773a06afd6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64232397, jitterRate=-0.042862698435783386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:20,238 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bfc034d276e222013aeb52773a06afd6: Writing region info on filesystem at 1676153000212Initializing all the Stores at 1676153000214 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153000214Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153000214Region opened successfully at 1676153000238 (+24 ms) 2023-02-11 22:03:20,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bfc034d276e222013aeb52773a06afd6, disabling compactions & flushes 2023-02-11 22:03:20,288 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:20,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:20,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. after waiting 0 ms 2023-02-11 22:03:20,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:20,293 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:20,293 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bfc034d276e222013aeb52773a06afd6: Waiting for close lock at 1676153000288Disabling compacts and flushes for region at 1676153000288Disabling writes for close at 1676153000288Writing region close event to WAL at 1676153000293 (+5 ms)Closed at 1676153000293 2023-02-11 22:03:20,301 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:20,301 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:20,303 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:20,307 INFO [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:20,309 DEBUG [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1 2023-02-11 22:03:20,309 INFO [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f94672b7a9e77d5e94937bdc8274bd85 columnFamilyName f1 2023-02-11 22:03:20,317 DEBUG [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1/testWithMapReduce=f94672b7a9e77d5e94937bdc8274bd85-e20b34977f0143cb9d2efe553b372a37 2023-02-11 22:03:20,317 INFO [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] regionserver.HStore(310): Store=f94672b7a9e77d5e94937bdc8274bd85/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:20,317 INFO [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:20,319 DEBUG [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2 2023-02-11 22:03:20,319 INFO [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f94672b7a9e77d5e94937bdc8274bd85 columnFamilyName f2 2023-02-11 22:03:20,325 DEBUG [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2/testWithMapReduce=f94672b7a9e77d5e94937bdc8274bd85-3e3987dbe22a4802a7ae4861691f0517 2023-02-11 22:03:20,325 INFO [StoreOpener-f94672b7a9e77d5e94937bdc8274bd85-1] regionserver.HStore(310): Store=f94672b7a9e77d5e94937bdc8274bd85/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:20,326 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:20,326 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f94672b7a9e77d5e94937bdc8274bd85; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63620911, jitterRate=-0.051974549889564514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:20,326 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f94672b7a9e77d5e94937bdc8274bd85: Writing region info on filesystem at 1676153000303Initializing all the Stores at 1676153000304 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153000304Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153000307 (+3 ms)Region opened successfully at 1676153000326 (+19 ms) 2023-02-11 22:03:20,385 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f94672b7a9e77d5e94937bdc8274bd85, disabling compactions & flushes 2023-02-11 22:03:20,385 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:20,385 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:20,385 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. after waiting 0 ms 2023-02-11 22:03:20,385 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:20,393 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:20,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f94672b7a9e77d5e94937bdc8274bd85: Waiting for close lock at 1676153000385Disabling compacts and flushes for region at 1676153000385Disabling writes for close at 1676153000385Writing region close event to WAL at 1676153000393 (+8 ms)Closed at 1676153000393 2023-02-11 22:03:20,397 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:20,398 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:20,399 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:20,401 INFO [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:20,402 DEBUG [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1 2023-02-11 22:03:20,402 INFO [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4cad0c1194b343e8e4a32ae9e644935 columnFamilyName f1 2023-02-11 22:03:20,409 DEBUG [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1/testWithMapReduce=f4cad0c1194b343e8e4a32ae9e644935-c7ed72f2ede04f699e2a5e425d4f19ac 2023-02-11 22:03:20,409 INFO [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] regionserver.HStore(310): Store=f4cad0c1194b343e8e4a32ae9e644935/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:20,410 INFO [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:20,411 DEBUG [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2 2023-02-11 22:03:20,411 INFO [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4cad0c1194b343e8e4a32ae9e644935 columnFamilyName f2 2023-02-11 22:03:20,420 DEBUG [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] regionserver.HStore(539): loaded hdfs://localhost:38825/user/jenkins/test-data/e725cee6-ec76-0833-4efc-4c4d6d0a215a/testWithMapReduceMultiRegion/7413b6f9-a616-4e42-8ebc-1e834953b8bb/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2/testWithMapReduce=f4cad0c1194b343e8e4a32ae9e644935-9decfeafd07b418b85357da0d03abce9 2023-02-11 22:03:20,420 INFO [StoreOpener-f4cad0c1194b343e8e4a32ae9e644935-1] regionserver.HStore(310): Store=f4cad0c1194b343e8e4a32ae9e644935/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:20,420 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:20,421 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f4cad0c1194b343e8e4a32ae9e644935; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71145709, jitterRate=0.06015367805957794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:20,421 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f4cad0c1194b343e8e4a32ae9e644935: Writing region info on filesystem at 1676153000400Initializing all the Stores at 1676153000400Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153000400Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153000400Region opened successfully at 1676153000421 (+21 ms) 2023-02-11 22:03:20,452 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f4cad0c1194b343e8e4a32ae9e644935, disabling compactions & flushes 2023-02-11 22:03:20,452 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:20,452 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:20,452 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. after waiting 0 ms 2023-02-11 22:03:20,452 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:20,455 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:20,456 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f4cad0c1194b343e8e4a32ae9e644935: Waiting for close lock at 1676153000452Disabling compacts and flushes for region at 1676153000452Disabling writes for close at 1676153000452Writing region close event to WAL at 1676153000455 (+3 ms)Closed at 1676153000455 2023-02-11 22:03:21,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "testWithMapReduceMultiRegion" 2023-02-11 22:03:21,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-11 22:03:21,552 INFO [Listener at localhost/34175] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 22:03:21,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-11 22:03:21,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-11 22:03:21,565 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153001565"}]},"ts":"1676153001565"} 2023-02-11 22:03:21,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 22:03:21,567 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-11 22:03:21,569 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-11 22:03:21,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5463b0e9cdead8e921a4e0076db0f66c, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0519adef6e85fa187149abd26f95f098, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bfc034d276e222013aeb52773a06afd6, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f4cad0c1194b343e8e4a32ae9e644935, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f94672b7a9e77d5e94937bdc8274bd85, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=870d3bbd554356b61360331b0eb3e04a, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=961f290dab68a52635871a37265197e0, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3be2765ad731f78cd1d3670b14ea6f94, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=070a5c745f9f5c517b1901b17b8947dc, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8a388f03d58c0b175fddfdd1441825c7, UNASSIGN}] 2023-02-11 22:03:21,575 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5463b0e9cdead8e921a4e0076db0f66c, UNASSIGN 2023-02-11 22:03:21,576 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0519adef6e85fa187149abd26f95f098, UNASSIGN 2023-02-11 22:03:21,576 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=070a5c745f9f5c517b1901b17b8947dc, UNASSIGN 2023-02-11 22:03:21,576 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3be2765ad731f78cd1d3670b14ea6f94, UNASSIGN 2023-02-11 22:03:21,577 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8a388f03d58c0b175fddfdd1441825c7, UNASSIGN 2023-02-11 22:03:21,577 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=5463b0e9cdead8e921a4e0076db0f66c, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:21,578 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676153001577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153001577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153001577"}]},"ts":"1676153001577"} 2023-02-11 22:03:21,578 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=070a5c745f9f5c517b1901b17b8947dc, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:21,578 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8a388f03d58c0b175fddfdd1441825c7, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:21,578 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=0519adef6e85fa187149abd26f95f098, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:21,578 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3be2765ad731f78cd1d3670b14ea6f94, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:21,578 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676153001578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153001578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153001578"}]},"ts":"1676153001578"} 2023-02-11 22:03:21,578 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153001578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153001578"}]},"ts":"1676153001578"} 2023-02-11 22:03:21,578 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153001578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153001578"}]},"ts":"1676153001578"} 2023-02-11 22:03:21,578 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153001578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153001578"}]},"ts":"1676153001578"} 2023-02-11 22:03:21,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=34, state=RUNNABLE; CloseRegionProcedure 5463b0e9cdead8e921a4e0076db0f66c, server=jenkins-hbase9.apache.org,34009,1676152989925}] 2023-02-11 22:03:21,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; CloseRegionProcedure 8a388f03d58c0b175fddfdd1441825c7, server=jenkins-hbase9.apache.org,42223,1676152989972}] 2023-02-11 22:03:21,585 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=41, state=RUNNABLE; CloseRegionProcedure 3be2765ad731f78cd1d3670b14ea6f94, server=jenkins-hbase9.apache.org,42223,1676152989972}] 2023-02-11 22:03:21,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; CloseRegionProcedure 0519adef6e85fa187149abd26f95f098, server=jenkins-hbase9.apache.org,42223,1676152989972}] 2023-02-11 22:03:21,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=42, state=RUNNABLE; CloseRegionProcedure 070a5c745f9f5c517b1901b17b8947dc, server=jenkins-hbase9.apache.org,34009,1676152989925}] 2023-02-11 22:03:21,598 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=961f290dab68a52635871a37265197e0, UNASSIGN 2023-02-11 22:03:21,599 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=870d3bbd554356b61360331b0eb3e04a, UNASSIGN 2023-02-11 22:03:21,599 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=961f290dab68a52635871a37265197e0, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:21,599 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676152992815.961f290dab68a52635871a37265197e0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001599"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153001599"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153001599"}]},"ts":"1676153001599"} 2023-02-11 22:03:21,599 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f94672b7a9e77d5e94937bdc8274bd85, UNASSIGN 2023-02-11 22:03:21,601 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f4cad0c1194b343e8e4a32ae9e644935, UNASSIGN 2023-02-11 22:03:21,601 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bfc034d276e222013aeb52773a06afd6, UNASSIGN 2023-02-11 22:03:21,601 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=870d3bbd554356b61360331b0eb3e04a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:21,601 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153001601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153001601"}]},"ts":"1676153001601"} 2023-02-11 22:03:21,601 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f94672b7a9e77d5e94937bdc8274bd85, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:21,602 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153001601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153001601"}]},"ts":"1676153001601"} 2023-02-11 22:03:21,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=40, state=RUNNABLE; CloseRegionProcedure 961f290dab68a52635871a37265197e0, server=jenkins-hbase9.apache.org,34009,1676152989925}] 2023-02-11 22:03:21,603 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f4cad0c1194b343e8e4a32ae9e644935, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:21,603 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001602"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153001602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153001602"}]},"ts":"1676153001602"} 2023-02-11 22:03:21,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=38, state=RUNNABLE; CloseRegionProcedure f94672b7a9e77d5e94937bdc8274bd85, server=jenkins-hbase9.apache.org,42223,1676152989972}] 2023-02-11 22:03:21,606 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=bfc034d276e222013aeb52773a06afd6, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:21,606 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153001606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153001606"}]},"ts":"1676153001606"} 2023-02-11 22:03:21,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=39, state=RUNNABLE; CloseRegionProcedure 870d3bbd554356b61360331b0eb3e04a, server=jenkins-hbase9.apache.org,42223,1676152989972}] 2023-02-11 22:03:21,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=37, state=RUNNABLE; CloseRegionProcedure f4cad0c1194b343e8e4a32ae9e644935, server=jenkins-hbase9.apache.org,34009,1676152989925}] 2023-02-11 22:03:21,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=36, state=RUNNABLE; CloseRegionProcedure bfc034d276e222013aeb52773a06afd6, server=jenkins-hbase9.apache.org,34009,1676152989925}] 2023-02-11 22:03:21,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 22:03:21,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:21,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 870d3bbd554356b61360331b0eb3e04a, disabling compactions & flushes 2023-02-11 22:03:21,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:21,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:21,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. after waiting 0 ms 2023-02-11 22:03:21,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:21,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:21,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 070a5c745f9f5c517b1901b17b8947dc, disabling compactions & flushes 2023-02-11 22:03:21,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:21,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:21,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. after waiting 0 ms 2023-02-11 22:03:21,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:21,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:21,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:21,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc. 2023-02-11 22:03:21,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a. 2023-02-11 22:03:21,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 070a5c745f9f5c517b1901b17b8947dc: Waiting for close lock at 1676153001787Running coprocessor pre-close hooks at 1676153001787Disabling compacts and flushes for region at 1676153001787Disabling writes for close at 1676153001787Writing region close event to WAL at 1676153001816 (+29 ms)Running coprocessor post-close hooks at 1676153001820 (+4 ms)Closed at 1676153001821 (+1 ms) 2023-02-11 22:03:21,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 870d3bbd554356b61360331b0eb3e04a: Waiting for close lock at 1676153001754Running coprocessor pre-close hooks at 1676153001754Disabling compacts and flushes for region at 1676153001754Disabling writes for close at 1676153001754Writing region close event to WAL at 1676153001815 (+61 ms)Running coprocessor post-close hooks at 1676153001820 (+5 ms)Closed at 1676153001821 (+1 ms) 2023-02-11 22:03:21,824 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=870d3bbd554356b61360331b0eb3e04a, regionState=CLOSED 2023-02-11 22:03:21,824 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001824"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153001824"}]},"ts":"1676153001824"} 2023-02-11 22:03:21,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:21,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:21,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 3be2765ad731f78cd1d3670b14ea6f94, disabling compactions & flushes 2023-02-11 22:03:21,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:21,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:21,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. after waiting 0 ms 2023-02-11 22:03:21,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:21,826 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=070a5c745f9f5c517b1901b17b8947dc, regionState=CLOSED 2023-02-11 22:03:21,826 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153001826"}]},"ts":"1676153001826"} 2023-02-11 22:03:21,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:21,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 961f290dab68a52635871a37265197e0 2023-02-11 22:03:21,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 961f290dab68a52635871a37265197e0, disabling compactions & flushes 2023-02-11 22:03:21,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:21,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:21,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. after waiting 0 ms 2023-02-11 22:03:21,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:21,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=39 2023-02-11 22:03:21,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=39, state=SUCCESS; CloseRegionProcedure 870d3bbd554356b61360331b0eb3e04a, server=jenkins-hbase9.apache.org,42223,1676152989972 in 224 msec 2023-02-11 22:03:21,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=42 2023-02-11 22:03:21,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=42, state=SUCCESS; CloseRegionProcedure 070a5c745f9f5c517b1901b17b8947dc, server=jenkins-hbase9.apache.org,34009,1676152989925 in 243 msec 2023-02-11 22:03:21,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:21,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=870d3bbd554356b61360331b0eb3e04a, UNASSIGN in 263 msec 2023-02-11 22:03:21,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94. 2023-02-11 22:03:21,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 3be2765ad731f78cd1d3670b14ea6f94: Waiting for close lock at 1676153001825Running coprocessor pre-close hooks at 1676153001825Disabling compacts and flushes for region at 1676153001825Disabling writes for close at 1676153001825Writing region close event to WAL at 1676153001829 (+4 ms)Running coprocessor post-close hooks at 1676153001838 (+9 ms)Closed at 1676153001839 (+1 ms) 2023-02-11 22:03:21,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:21,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0. 2023-02-11 22:03:21,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 961f290dab68a52635871a37265197e0: Waiting for close lock at 1676153001827Running coprocessor pre-close hooks at 1676153001827Disabling compacts and flushes for region at 1676153001827Disabling writes for close at 1676153001828 (+1 ms)Writing region close event to WAL at 1676153001835 (+7 ms)Running coprocessor post-close hooks at 1676153001847 (+12 ms)Closed at 1676153001848 (+1 ms) 2023-02-11 22:03:21,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=070a5c745f9f5c517b1901b17b8947dc, UNASSIGN in 263 msec 2023-02-11 22:03:21,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:21,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:21,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing f94672b7a9e77d5e94937bdc8274bd85, disabling compactions & flushes 2023-02-11 22:03:21,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:21,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:21,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. after waiting 0 ms 2023-02-11 22:03:21,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:21,849 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3be2765ad731f78cd1d3670b14ea6f94, regionState=CLOSED 2023-02-11 22:03:21,850 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001849"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153001849"}]},"ts":"1676153001849"} 2023-02-11 22:03:21,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 961f290dab68a52635871a37265197e0 2023-02-11 22:03:21,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:21,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 5463b0e9cdead8e921a4e0076db0f66c, disabling compactions & flushes 2023-02-11 22:03:21,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:21,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:21,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. after waiting 0 ms 2023-02-11 22:03:21,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:21,851 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=961f290dab68a52635871a37265197e0, regionState=CLOSED 2023-02-11 22:03:21,851 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676152992815.961f290dab68a52635871a37265197e0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153001851"}]},"ts":"1676153001851"} 2023-02-11 22:03:21,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=41 2023-02-11 22:03:21,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=41, state=SUCCESS; CloseRegionProcedure 3be2765ad731f78cd1d3670b14ea6f94, server=jenkins-hbase9.apache.org,42223,1676152989972 in 267 msec 2023-02-11 22:03:21,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=40 2023-02-11 22:03:21,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=40, state=SUCCESS; CloseRegionProcedure 961f290dab68a52635871a37265197e0, server=jenkins-hbase9.apache.org,34009,1676152989925 in 251 msec 2023-02-11 22:03:21,858 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3be2765ad731f78cd1d3670b14ea6f94, UNASSIGN in 285 msec 2023-02-11 22:03:21,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=961f290dab68a52635871a37265197e0, UNASSIGN in 285 msec 2023-02-11 22:03:21,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 22:03:21,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 22:03:21,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c. 2023-02-11 22:03:21,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 5463b0e9cdead8e921a4e0076db0f66c: Waiting for close lock at 1676153001850Running coprocessor pre-close hooks at 1676153001850Disabling compacts and flushes for region at 1676153001850Disabling writes for close at 1676153001851 (+1 ms)Writing region close event to WAL at 1676153001864 (+13 ms)Running coprocessor post-close hooks at 1676153001873 (+9 ms)Closed at 1676153001873 2023-02-11 22:03:21,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:21,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:21,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing f4cad0c1194b343e8e4a32ae9e644935, disabling compactions & flushes 2023-02-11 22:03:21,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:21,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:21,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. after waiting 0 ms 2023-02-11 22:03:21,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:21,876 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=5463b0e9cdead8e921a4e0076db0f66c, regionState=CLOSED 2023-02-11 22:03:21,876 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676153001876"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153001876"}]},"ts":"1676153001876"} 2023-02-11 22:03:21,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:21,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85. 2023-02-11 22:03:21,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for f94672b7a9e77d5e94937bdc8274bd85: Waiting for close lock at 1676153001849Running coprocessor pre-close hooks at 1676153001849Disabling compacts and flushes for region at 1676153001849Disabling writes for close at 1676153001849Writing region close event to WAL at 1676153001869 (+20 ms)Running coprocessor post-close hooks at 1676153001880 (+11 ms)Closed at 1676153001880 2023-02-11 22:03:21,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=34 2023-02-11 22:03:21,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=34, state=SUCCESS; CloseRegionProcedure 5463b0e9cdead8e921a4e0076db0f66c, server=jenkins-hbase9.apache.org,34009,1676152989925 in 298 msec 2023-02-11 22:03:21,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:21,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:21,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 8a388f03d58c0b175fddfdd1441825c7, disabling compactions & flushes 2023-02-11 22:03:21,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:21,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:21,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. after waiting 0 ms 2023-02-11 22:03:21,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:21,883 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f94672b7a9e77d5e94937bdc8274bd85, regionState=CLOSED 2023-02-11 22:03:21,883 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001883"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153001883"}]},"ts":"1676153001883"} 2023-02-11 22:03:21,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5463b0e9cdead8e921a4e0076db0f66c, UNASSIGN in 311 msec 2023-02-11 22:03:21,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=38 2023-02-11 22:03:21,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=38, state=SUCCESS; CloseRegionProcedure f94672b7a9e77d5e94937bdc8274bd85, server=jenkins-hbase9.apache.org,42223,1676152989972 in 280 msec 2023-02-11 22:03:21,890 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f94672b7a9e77d5e94937bdc8274bd85, UNASSIGN in 317 msec 2023-02-11 22:03:21,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:21,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 22:03:21,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935. 2023-02-11 22:03:21,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for f4cad0c1194b343e8e4a32ae9e644935: Waiting for close lock at 1676153001876Running coprocessor pre-close hooks at 1676153001876Disabling compacts and flushes for region at 1676153001876Disabling writes for close at 1676153001876Writing region close event to WAL at 1676153001888 (+12 ms)Running coprocessor post-close hooks at 1676153001899 (+11 ms)Closed at 1676153001900 (+1 ms) 2023-02-11 22:03:21,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7. 2023-02-11 22:03:21,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 8a388f03d58c0b175fddfdd1441825c7: Waiting for close lock at 1676153001882Running coprocessor pre-close hooks at 1676153001882Disabling compacts and flushes for region at 1676153001882Disabling writes for close at 1676153001882Writing region close event to WAL at 1676153001887 (+5 ms)Running coprocessor post-close hooks at 1676153001901 (+14 ms)Closed at 1676153001902 (+1 ms) 2023-02-11 22:03:21,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:21,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:21,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing bfc034d276e222013aeb52773a06afd6, disabling compactions & flushes 2023-02-11 22:03:21,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:21,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:21,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. after waiting 0 ms 2023-02-11 22:03:21,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:21,904 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f4cad0c1194b343e8e4a32ae9e644935, regionState=CLOSED 2023-02-11 22:03:21,904 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001904"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153001904"}]},"ts":"1676153001904"} 2023-02-11 22:03:21,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:21,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:21,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 0519adef6e85fa187149abd26f95f098, disabling compactions & flushes 2023-02-11 22:03:21,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:21,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:21,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. after waiting 0 ms 2023-02-11 22:03:21,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:21,905 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8a388f03d58c0b175fddfdd1441825c7, regionState=CLOSED 2023-02-11 22:03:21,906 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676153001905"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153001905"}]},"ts":"1676153001905"} 2023-02-11 22:03:21,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=37 2023-02-11 22:03:21,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=37, state=SUCCESS; CloseRegionProcedure f4cad0c1194b343e8e4a32ae9e644935, server=jenkins-hbase9.apache.org,34009,1676152989925 in 297 msec 2023-02-11 22:03:21,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-02-11 22:03:21,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; CloseRegionProcedure 8a388f03d58c0b175fddfdd1441825c7, server=jenkins-hbase9.apache.org,42223,1676152989972 in 325 msec 2023-02-11 22:03:21,911 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f4cad0c1194b343e8e4a32ae9e644935, UNASSIGN in 338 msec 2023-02-11 22:03:21,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8a388f03d58c0b175fddfdd1441825c7, UNASSIGN in 337 msec 2023-02-11 22:03:21,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:21,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:21,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6. 2023-02-11 22:03:21,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for bfc034d276e222013aeb52773a06afd6: Waiting for close lock at 1676153001903Running coprocessor pre-close hooks at 1676153001903Disabling compacts and flushes for region at 1676153001903Disabling writes for close at 1676153001904 (+1 ms)Writing region close event to WAL at 1676153001915 (+11 ms)Running coprocessor post-close hooks at 1676153001920 (+5 ms)Closed at 1676153001921 (+1 ms) 2023-02-11 22:03:21,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098. 2023-02-11 22:03:21,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 0519adef6e85fa187149abd26f95f098: Waiting for close lock at 1676153001905Running coprocessor pre-close hooks at 1676153001905Disabling compacts and flushes for region at 1676153001905Disabling writes for close at 1676153001905Writing region close event to WAL at 1676153001916 (+11 ms)Running coprocessor post-close hooks at 1676153001922 (+6 ms)Closed at 1676153001922 2023-02-11 22:03:21,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:21,925 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=bfc034d276e222013aeb52773a06afd6, regionState=CLOSED 2023-02-11 22:03:21,925 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001924"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153001924"}]},"ts":"1676153001924"} 2023-02-11 22:03:21,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:21,926 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=0519adef6e85fa187149abd26f95f098, regionState=CLOSED 2023-02-11 22:03:21,926 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153001926"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153001926"}]},"ts":"1676153001926"} 2023-02-11 22:03:21,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=36 2023-02-11 22:03:21,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=36, state=SUCCESS; CloseRegionProcedure bfc034d276e222013aeb52773a06afd6, server=jenkins-hbase9.apache.org,34009,1676152989925 in 317 msec 2023-02-11 22:03:21,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-02-11 22:03:21,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; CloseRegionProcedure 0519adef6e85fa187149abd26f95f098, server=jenkins-hbase9.apache.org,42223,1676152989972 in 341 msec 2023-02-11 22:03:21,933 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bfc034d276e222013aeb52773a06afd6, UNASSIGN in 360 msec 2023-02-11 22:03:21,935 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=33 2023-02-11 22:03:21,935 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0519adef6e85fa187149abd26f95f098, UNASSIGN in 361 msec 2023-02-11 22:03:21,936 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153001936"}]},"ts":"1676153001936"} 2023-02-11 22:03:21,938 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-11 22:03:21,940 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-11 22:03:21,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 387 msec 2023-02-11 22:03:22,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 22:03:22,173 INFO [Listener at localhost/34175] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-11 22:03:22,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testWithMapReduce 2023-02-11 22:03:22,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-11 22:03:22,188 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 22:03:22,190 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 22:03:22,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 22:03:22,209 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:22,209 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:22,209 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:22,209 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:22,209 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:22,209 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:22,209 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:22,209 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0 2023-02-11 22:03:22,215 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/f1, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/f2, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/recovered.edits] 2023-02-11 22:03:22,215 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/recovered.edits] 2023-02-11 22:03:22,215 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/recovered.edits] 2023-02-11 22:03:22,215 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/recovered.edits] 2023-02-11 22:03:22,216 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/recovered.edits] 2023-02-11 22:03:22,217 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/recovered.edits] 2023-02-11 22:03:22,217 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/recovered.edits] 2023-02-11 22:03:22,220 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/recovered.edits] 2023-02-11 22:03:22,229 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1/e20b34977f0143cb9d2efe553b372a37 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1/e20b34977f0143cb9d2efe553b372a37 2023-02-11 22:03:22,229 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1/0e9c2fd88888488d8c191f2c779f7fc3 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1/0e9c2fd88888488d8c191f2c779f7fc3 2023-02-11 22:03:22,230 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1/521056934f854226a982a0a4019bd728 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1/521056934f854226a982a0a4019bd728 2023-02-11 22:03:22,230 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1/7e0f32ccc0d34ee9a3adb96c81ea401a to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1/7e0f32ccc0d34ee9a3adb96c81ea401a 2023-02-11 22:03:22,231 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1/9d2554424fe541808b3980444392b528 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1/9d2554424fe541808b3980444392b528 2023-02-11 22:03:22,231 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1/bed88230285f42bbae09aa46db879fcb to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1/bed88230285f42bbae09aa46db879fcb 2023-02-11 22:03:22,233 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1/9b948254fafa442d8746b4e4eaaa983f to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f1/9b948254fafa442d8746b4e4eaaa983f 2023-02-11 22:03:22,234 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1/0d85de40e16f44a1aa4f12055f6d6c53 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1/0d85de40e16f44a1aa4f12055f6d6c53 2023-02-11 22:03:22,234 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1/a02cdf45b6b641a198c309cb8b87f3f6 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f1/a02cdf45b6b641a198c309cb8b87f3f6 2023-02-11 22:03:22,235 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1/ea28b0bc541d45abb00d8d391525e3fb to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f1/ea28b0bc541d45abb00d8d391525e3fb 2023-02-11 22:03:22,235 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1/e4e34cb35ca542c2b5f1c15215ecb517 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f1/e4e34cb35ca542c2b5f1c15215ecb517 2023-02-11 22:03:22,235 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1/e693e0b9be4e48e59e5f0a16bc5b8540 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f1/e693e0b9be4e48e59e5f0a16bc5b8540 2023-02-11 22:03:22,236 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1/f67cb26451f641cc98cc335be171cdd2 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f1/f67cb26451f641cc98cc335be171cdd2 2023-02-11 22:03:22,237 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/recovered.edits/6.seqid to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c/recovered.edits/6.seqid 2023-02-11 22:03:22,239 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1/c7ed72f2ede04f699e2a5e425d4f19ac to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f1/c7ed72f2ede04f699e2a5e425d4f19ac 2023-02-11 22:03:22,239 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/5463b0e9cdead8e921a4e0076db0f66c 2023-02-11 22:03:22,239 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:22,243 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2/1a791654312e47d49ac4ca5b516e3295 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2/1a791654312e47d49ac4ca5b516e3295 2023-02-11 22:03:22,243 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2/37cc686f40cf4fd9b1f237d3007c9680 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2/37cc686f40cf4fd9b1f237d3007c9680 2023-02-11 22:03:22,245 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/recovered.edits] 2023-02-11 22:03:22,245 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2/518bcc8e7a0d4504be5fd44e80fe935d to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2/518bcc8e7a0d4504be5fd44e80fe935d 2023-02-11 22:03:22,245 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2/61849e41d654471187f481aca53781cc to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2/61849e41d654471187f481aca53781cc 2023-02-11 22:03:22,246 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2/4e64ec6794d5407ea2f462d346a9a4b5 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/f2/4e64ec6794d5407ea2f462d346a9a4b5 2023-02-11 22:03:22,246 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2/7232174b130344f1917e312d083495f8 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/f2/7232174b130344f1917e312d083495f8 2023-02-11 22:03:22,247 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2/0a627474152241bb9fb22924f0b4db22 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2/0a627474152241bb9fb22924f0b4db22 2023-02-11 22:03:22,248 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2/3e3987dbe22a4802a7ae4861691f0517 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2/3e3987dbe22a4802a7ae4861691f0517 2023-02-11 22:03:22,250 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2/98623d2648d4439596b9e4d82a5b3f57 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/f2/98623d2648d4439596b9e4d82a5b3f57 2023-02-11 22:03:22,250 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2/3473e715a71342ad98332a823b9a21b4 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2/3473e715a71342ad98332a823b9a21b4 2023-02-11 22:03:22,250 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2/e0166dc26b6740368626c2c227790adc to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/f2/e0166dc26b6740368626c2c227790adc 2023-02-11 22:03:22,251 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2/db6f11155163452aa33eefb57450909a to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/f2/db6f11155163452aa33eefb57450909a 2023-02-11 22:03:22,252 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2/4d6467acdba44c43a9c56a7f9bb37033 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/f2/4d6467acdba44c43a9c56a7f9bb37033 2023-02-11 22:03:22,254 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2/9decfeafd07b418b85357da0d03abce9 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/f2/9decfeafd07b418b85357da0d03abce9 2023-02-11 22:03:22,257 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/recovered.edits/12.seqid to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6/recovered.edits/12.seqid 2023-02-11 22:03:22,258 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1/3ab65fd16f7e471f8385886425111068 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1/3ab65fd16f7e471f8385886425111068 2023-02-11 22:03:22,259 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/recovered.edits/12.seqid to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a/recovered.edits/12.seqid 2023-02-11 22:03:22,259 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/bfc034d276e222013aeb52773a06afd6 2023-02-11 22:03:22,259 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:22,260 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/870d3bbd554356b61360331b0eb3e04a 2023-02-11 22:03:22,260 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/recovered.edits/12.seqid to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94/recovered.edits/12.seqid 2023-02-11 22:03:22,262 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/recovered.edits/12.seqid to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0/recovered.edits/12.seqid 2023-02-11 22:03:22,262 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/3be2765ad731f78cd1d3670b14ea6f94 2023-02-11 22:03:22,263 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/recovered.edits/12.seqid to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85/recovered.edits/12.seqid 2023-02-11 22:03:22,263 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/recovered.edits/12.seqid to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098/recovered.edits/12.seqid 2023-02-11 22:03:22,263 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/961f290dab68a52635871a37265197e0 2023-02-11 22:03:22,263 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1/e2e34d5434db46229b6b6d95063f9158 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f1/e2e34d5434db46229b6b6d95063f9158 2023-02-11 22:03:22,264 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/0519adef6e85fa187149abd26f95f098 2023-02-11 22:03:22,264 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f94672b7a9e77d5e94937bdc8274bd85 2023-02-11 22:03:22,265 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/f1, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/f2, FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/recovered.edits] 2023-02-11 22:03:22,272 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/recovered.edits/12.seqid to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935/recovered.edits/12.seqid 2023-02-11 22:03:22,272 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/f4cad0c1194b343e8e4a32ae9e644935 2023-02-11 22:03:22,275 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2/9955e2c462094d7c9728ec0f1aa6b992 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2/9955e2c462094d7c9728ec0f1aa6b992 2023-02-11 22:03:22,276 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2/9d675feb919d4c3b958796ef40a222a4 to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/f2/9d675feb919d4c3b958796ef40a222a4 2023-02-11 22:03:22,278 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/recovered.edits/6.seqid to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7/recovered.edits/6.seqid 2023-02-11 22:03:22,279 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/8a388f03d58c0b175fddfdd1441825c7 2023-02-11 22:03:22,281 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/recovered.edits/12.seqid to hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/archive/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc/recovered.edits/12.seqid 2023-02-11 22:03:22,281 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/.tmp/data/default/testWithMapReduce/070a5c745f9f5c517b1901b17b8947dc 2023-02-11 22:03:22,281 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 22:03:22,284 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 22:03:22,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 22:03:22,316 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-11 22:03:22,328 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-11 22:03:22,330 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 22:03:22,330 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-11 22:03:22,330 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153002330"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:22,330 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153002330"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:22,330 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153002330"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:22,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153002330"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:22,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153002330"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:22,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153002330"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:22,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676152992815.961f290dab68a52635871a37265197e0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153002330"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:22,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153002330"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:22,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153002330"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:22,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153002330"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:22,340 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-11 22:03:22,341 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5463b0e9cdead8e921a4e0076db0f66c, NAME => 'testWithMapReduce,,1676152992815.5463b0e9cdead8e921a4e0076db0f66c.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 0519adef6e85fa187149abd26f95f098, NAME => 'testWithMapReduce,aaa,1676152992815.0519adef6e85fa187149abd26f95f098.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => bfc034d276e222013aeb52773a06afd6, NAME => 'testWithMapReduce,d\x84\x84,1676152992815.bfc034d276e222013aeb52773a06afd6.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => f4cad0c1194b343e8e4a32ae9e644935, NAME => 'testWithMapReduce,g\xA7\xA7,1676152992815.f4cad0c1194b343e8e4a32ae9e644935.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => f94672b7a9e77d5e94937bdc8274bd85, NAME => 'testWithMapReduce,j\xCA\xCA,1676152992815.f94672b7a9e77d5e94937bdc8274bd85.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 870d3bbd554356b61360331b0eb3e04a, NAME => 'testWithMapReduce,m\xED\xED,1676152992815.870d3bbd554356b61360331b0eb3e04a.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 961f290dab68a52635871a37265197e0, NAME => 'testWithMapReduce,q\x11\x10,1676152992815.961f290dab68a52635871a37265197e0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 3be2765ad731f78cd1d3670b14ea6f94, NAME => 'testWithMapReduce,t43,1676152992815.3be2765ad731f78cd1d3670b14ea6f94.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 070a5c745f9f5c517b1901b17b8947dc, NAME => 'testWithMapReduce,wWV,1676152992815.070a5c745f9f5c517b1901b17b8947dc.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 8a388f03d58c0b175fddfdd1441825c7, NAME => 'testWithMapReduce,zz{,1676152992815.8a388f03d58c0b175fddfdd1441825c7.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-11 22:03:22,341 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-11 22:03:22,341 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676153002341"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:22,345 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-11 22:03:22,347 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 22:03:22,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 169 msec 2023-02-11 22:03:22,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46805] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 22:03:22,495 INFO [Listener at localhost/34175] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-11 22:03:22,495 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 22:03:22,495 INFO [Listener at localhost/34175] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 22:03:22,495 DEBUG [Listener at localhost/34175] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x030f8fa7 to 127.0.0.1:58719 2023-02-11 22:03:22,495 DEBUG [Listener at localhost/34175] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:22,495 DEBUG [Listener at localhost/34175] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 22:03:22,496 DEBUG [Listener at localhost/34175] util.JVMClusterUtil(257): Found active master hash=1180782081, stopped=false 2023-02-11 22:03:22,496 INFO [Listener at localhost/34175] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,46805,1676152988691 2023-02-11 22:03:22,499 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:22,499 INFO [Listener at localhost/34175] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 22:03:22,499 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:22,499 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:22,499 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:22,500 DEBUG [Listener at localhost/34175] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cbbe167 to 127.0.0.1:58719 2023-02-11 22:03:22,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:22,500 DEBUG [Listener at localhost/34175] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:22,500 INFO [Listener at localhost/34175] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,34009,1676152989925' ***** 2023-02-11 22:03:22,500 INFO [Listener at localhost/34175] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:22,500 INFO [Listener at localhost/34175] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,42223,1676152989972' ***** 2023-02-11 22:03:22,501 INFO [Listener at localhost/34175] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:22,501 INFO [RS:0;jenkins-hbase9:34009] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:22,501 INFO [RS:1;jenkins-hbase9:42223] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:22,501 INFO [RS:0;jenkins-hbase9:34009] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:22,501 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:22,501 INFO [RS:0;jenkins-hbase9:34009] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:22,502 INFO [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(3304): Received CLOSE for 3c6b21a8ffaa54a0d6f207ebbe3166fe 2023-02-11 22:03:22,501 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:22,501 INFO [RS:1;jenkins-hbase9:42223] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:22,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:22,503 INFO [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:22,503 DEBUG [RS:0;jenkins-hbase9:34009] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16d5abf1 to 127.0.0.1:58719 2023-02-11 22:03:22,503 DEBUG [RS:0;jenkins-hbase9:34009] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:22,503 INFO [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 22:03:22,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:22,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 3c6b21a8ffaa54a0d6f207ebbe3166fe, disabling compactions & flushes 2023-02-11 22:03:22,503 INFO [RS:1;jenkins-hbase9:42223] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:22,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. 2023-02-11 22:03:22,503 DEBUG [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(1479): Online Regions={3c6b21a8ffaa54a0d6f207ebbe3166fe=hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe.} 2023-02-11 22:03:22,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. 2023-02-11 22:03:22,504 INFO [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:22,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. after waiting 0 ms 2023-02-11 22:03:22,504 DEBUG [RS:1;jenkins-hbase9:42223] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7764377c to 127.0.0.1:58719 2023-02-11 22:03:22,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. 2023-02-11 22:03:22,504 DEBUG [RS:1;jenkins-hbase9:42223] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:22,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 3c6b21a8ffaa54a0d6f207ebbe3166fe 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 22:03:22,504 INFO [RS:1;jenkins-hbase9:42223] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:22,504 INFO [RS:1;jenkins-hbase9:42223] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:22,504 INFO [RS:1;jenkins-hbase9:42223] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:22,504 INFO [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 22:03:22,505 DEBUG [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(1505): Waiting on 3c6b21a8ffaa54a0d6f207ebbe3166fe 2023-02-11 22:03:22,505 INFO [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 22:03:22,506 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:22,506 DEBUG [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-11 22:03:22,506 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:22,506 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:22,506 DEBUG [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 22:03:22,506 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:22,506 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:22,506 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-11 22:03:22,510 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:22,511 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:22,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe/.tmp/info/ee96c4cbceb4455d97521f329a60b3ce 2023-02-11 22:03:22,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe/.tmp/info/ee96c4cbceb4455d97521f329a60b3ce as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe/info/ee96c4cbceb4455d97521f329a60b3ce 2023-02-11 22:03:22,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe/info/ee96c4cbceb4455d97521f329a60b3ce, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 22:03:22,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3c6b21a8ffaa54a0d6f207ebbe3166fe in 40ms, sequenceid=6, compaction requested=false 2023-02-11 22:03:22,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/namespace/3c6b21a8ffaa54a0d6f207ebbe3166fe/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 22:03:22,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. 2023-02-11 22:03:22,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 3c6b21a8ffaa54a0d6f207ebbe3166fe: Waiting for close lock at 1676153002503Running coprocessor pre-close hooks at 1676153002503Disabling compacts and flushes for region at 1676153002503Disabling writes for close at 1676153002504 (+1 ms)Obtaining lock to block concurrent updates at 1676153002504Preparing flush snapshotting stores in 3c6b21a8ffaa54a0d6f207ebbe3166fe at 1676153002504Finished memstore snapshotting hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676153002504Flushing stores of hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. at 1676153002506 (+2 ms)Flushing 3c6b21a8ffaa54a0d6f207ebbe3166fe/info: creating writer at 1676153002506Flushing 3c6b21a8ffaa54a0d6f207ebbe3166fe/info: appending metadata at 1676153002509 (+3 ms)Flushing 3c6b21a8ffaa54a0d6f207ebbe3166fe/info: closing flushed file at 1676153002509Flushing 3c6b21a8ffaa54a0d6f207ebbe3166fe/info: reopening flushed file at 1676153002538 (+29 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3c6b21a8ffaa54a0d6f207ebbe3166fe in 40ms, sequenceid=6, compaction requested=false at 1676153002544 (+6 ms)Writing region close event to WAL at 1676153002548 (+4 ms)Running coprocessor post-close hooks at 1676153002551 (+3 ms)Closed at 1676153002552 (+1 ms) 2023-02-11 22:03:22,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676152991968.3c6b21a8ffaa54a0d6f207ebbe3166fe. 2023-02-11 22:03:22,706 INFO [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,34009,1676152989925; all regions closed. 2023-02-11 22:03:22,707 DEBUG [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 22:03:22,714 DEBUG [RS:0;jenkins-hbase9:34009] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/oldWALs 2023-02-11 22:03:22,714 INFO [RS:0;jenkins-hbase9:34009] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C34009%2C1676152989925:(num 1676152992390) 2023-02-11 22:03:22,714 DEBUG [RS:0;jenkins-hbase9:34009] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:22,714 INFO [RS:0;jenkins-hbase9:34009] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:22,714 INFO [RS:0;jenkins-hbase9:34009] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:22,715 INFO [RS:0;jenkins-hbase9:34009] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:22,715 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:22,715 INFO [RS:0;jenkins-hbase9:34009] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:22,715 INFO [RS:0;jenkins-hbase9:34009] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:22,716 INFO [RS:0;jenkins-hbase9:34009] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:34009 2023-02-11 22:03:22,723 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:22,723 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:22,723 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:22,723 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,34009,1676152989925 2023-02-11 22:03:22,724 ERROR [Listener at localhost/34175-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e969770 rejected from java.util.concurrent.ThreadPoolExecutor@3aa9047a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:22,724 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:22,724 ERROR [Listener at localhost/34175-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4439948b rejected from java.util.concurrent.ThreadPoolExecutor@3aa9047a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:22,726 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,34009,1676152989925] 2023-02-11 22:03:22,726 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,34009,1676152989925; numProcessing=1 2023-02-11 22:03:22,727 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,34009,1676152989925 already deleted, retry=false 2023-02-11 22:03:22,728 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,34009,1676152989925 expired; onlineServers=1 2023-02-11 22:03:22,907 DEBUG [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 22:03:22,929 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/.tmp/info/84672b7311e34e2d8415add5aba50fc8 2023-02-11 22:03:22,935 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84672b7311e34e2d8415add5aba50fc8 2023-02-11 22:03:22,944 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/.tmp/rep_barrier/ab713c87c84347519fe868d88c8b40cf 2023-02-11 22:03:22,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab713c87c84347519fe868d88c8b40cf 2023-02-11 22:03:22,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/.tmp/table/11ef8f4a33d84d67add62afb3e1de2d6 2023-02-11 22:03:22,963 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 11ef8f4a33d84d67add62afb3e1de2d6 2023-02-11 22:03:22,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/.tmp/info/84672b7311e34e2d8415add5aba50fc8 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/info/84672b7311e34e2d8415add5aba50fc8 2023-02-11 22:03:22,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84672b7311e34e2d8415add5aba50fc8 2023-02-11 22:03:22,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/info/84672b7311e34e2d8415add5aba50fc8, entries=30, sequenceid=57, filesize=7.9 K 2023-02-11 22:03:22,970 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/.tmp/rep_barrier/ab713c87c84347519fe868d88c8b40cf as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/rep_barrier/ab713c87c84347519fe868d88c8b40cf 2023-02-11 22:03:22,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab713c87c84347519fe868d88c8b40cf 2023-02-11 22:03:22,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/rep_barrier/ab713c87c84347519fe868d88c8b40cf, entries=10, sequenceid=57, filesize=5.9 K 2023-02-11 22:03:22,976 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/.tmp/table/11ef8f4a33d84d67add62afb3e1de2d6 as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/table/11ef8f4a33d84d67add62afb3e1de2d6 2023-02-11 22:03:22,980 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 11ef8f4a33d84d67add62afb3e1de2d6 2023-02-11 22:03:22,980 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/table/11ef8f4a33d84d67add62afb3e1de2d6, entries=13, sequenceid=57, filesize=5.9 K 2023-02-11 22:03:22,981 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 475ms, sequenceid=57, compaction requested=false 2023-02-11 22:03:22,988 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-11 22:03:22,989 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 22:03:22,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:22,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153002506Running coprocessor pre-close hooks at 1676153002506Disabling compacts and flushes for region at 1676153002506Disabling writes for close at 1676153002506Obtaining lock to block concurrent updates at 1676153002506Preparing flush snapshotting stores in 1588230740 at 1676153002506Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676153002507 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676153002507Flushing 1588230740/info: creating writer at 1676153002507Flushing 1588230740/info: appending metadata at 1676153002513 (+6 ms)Flushing 1588230740/info: closing flushed file at 1676153002513Flushing 1588230740/rep_barrier: creating writer at 1676153002936 (+423 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676153002938 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676153002938Flushing 1588230740/table: creating writer at 1676153002949 (+11 ms)Flushing 1588230740/table: appending metadata at 1676153002952 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676153002952Flushing 1588230740/info: reopening flushed file at 1676153002964 (+12 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676153002971 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1676153002976 (+5 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 475ms, sequenceid=57, compaction requested=false at 1676153002981 (+5 ms)Writing region close event to WAL at 1676153002985 (+4 ms)Running coprocessor post-close hooks at 1676153002989 (+4 ms)Closed at 1676153002990 (+1 ms) 2023-02-11 22:03:22,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:23,000 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:23,000 INFO [RS:0;jenkins-hbase9:34009] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,34009,1676152989925; zookeeper connection closed. 2023-02-11 22:03:23,001 ERROR [Listener at localhost/34175-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c66f106 rejected from java.util.concurrent.ThreadPoolExecutor@3aa9047a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:23,001 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:34009-0x1004569c07f0001, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:23,001 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@13f3c1a4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@13f3c1a4 2023-02-11 22:03:23,001 ERROR [Listener at localhost/34175-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@179130b3 rejected from java.util.concurrent.ThreadPoolExecutor@3aa9047a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:23,107 INFO [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,42223,1676152989972; all regions closed. 2023-02-11 22:03:23,112 DEBUG [RS:1;jenkins-hbase9:42223] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/oldWALs 2023-02-11 22:03:23,113 INFO [RS:1;jenkins-hbase9:42223] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C42223%2C1676152989972.meta:.meta(num 1676152991704) 2023-02-11 22:03:23,117 DEBUG [RS:1;jenkins-hbase9:42223] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/oldWALs 2023-02-11 22:03:23,117 INFO [RS:1;jenkins-hbase9:42223] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C42223%2C1676152989972:(num 1676152992390) 2023-02-11 22:03:23,117 DEBUG [RS:1;jenkins-hbase9:42223] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:23,117 INFO [RS:1;jenkins-hbase9:42223] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:23,117 INFO [RS:1;jenkins-hbase9:42223] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:23,118 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:23,118 INFO [RS:1;jenkins-hbase9:42223] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:42223 2023-02-11 22:03:23,121 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:23,121 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,42223,1676152989972 2023-02-11 22:03:23,121 ERROR [Listener at localhost/34175-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@590711ab rejected from java.util.concurrent.ThreadPoolExecutor@5d389e53[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:23,122 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,42223,1676152989972] 2023-02-11 22:03:23,122 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,42223,1676152989972; numProcessing=2 2023-02-11 22:03:23,124 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,42223,1676152989972 already deleted, retry=false 2023-02-11 22:03:23,124 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,42223,1676152989972 expired; onlineServers=0 2023-02-11 22:03:23,124 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,46805,1676152988691' ***** 2023-02-11 22:03:23,124 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 22:03:23,125 DEBUG [M:0;jenkins-hbase9:46805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75c443a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:23,125 INFO [M:0;jenkins-hbase9:46805] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,46805,1676152988691 2023-02-11 22:03:23,125 INFO [M:0;jenkins-hbase9:46805] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,46805,1676152988691; all regions closed. 2023-02-11 22:03:23,125 DEBUG [M:0;jenkins-hbase9:46805] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:23,125 DEBUG [M:0;jenkins-hbase9:46805] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 22:03:23,125 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 22:03:23,126 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676152991172] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676152991172,5,FailOnTimeoutGroup] 2023-02-11 22:03:23,126 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676152991175] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676152991175,5,FailOnTimeoutGroup] 2023-02-11 22:03:23,125 DEBUG [M:0;jenkins-hbase9:46805] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 22:03:23,127 INFO [M:0;jenkins-hbase9:46805] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 22:03:23,127 INFO [M:0;jenkins-hbase9:46805] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 22:03:23,127 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:23,127 INFO [M:0;jenkins-hbase9:46805] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-11 22:03:23,128 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:23,128 DEBUG [M:0;jenkins-hbase9:46805] master.HMaster(1502): Stopping service threads 2023-02-11 22:03:23,128 INFO [M:0;jenkins-hbase9:46805] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 22:03:23,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:23,128 ERROR [M:0;jenkins-hbase9:46805] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-11 22:03:23,129 INFO [M:0;jenkins-hbase9:46805] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 22:03:23,129 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 22:03:23,129 DEBUG [M:0;jenkins-hbase9:46805] zookeeper.ZKUtil(398): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 22:03:23,129 WARN [M:0;jenkins-hbase9:46805] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 22:03:23,129 INFO [M:0;jenkins-hbase9:46805] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 22:03:23,130 INFO [M:0;jenkins-hbase9:46805] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 22:03:23,130 DEBUG [M:0;jenkins-hbase9:46805] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:23,130 INFO [M:0;jenkins-hbase9:46805] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:23,130 DEBUG [M:0;jenkins-hbase9:46805] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:23,130 DEBUG [M:0;jenkins-hbase9:46805] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:23,130 DEBUG [M:0;jenkins-hbase9:46805] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:23,130 INFO [M:0;jenkins-hbase9:46805] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.22 KB heapSize=192.14 KB 2023-02-11 22:03:23,149 INFO [M:0;jenkins-hbase9:46805] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.22 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6019c4d0349c44ba8ea51e5f8cdae9fe 2023-02-11 22:03:23,155 DEBUG [M:0;jenkins-hbase9:46805] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6019c4d0349c44ba8ea51e5f8cdae9fe as hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6019c4d0349c44ba8ea51e5f8cdae9fe 2023-02-11 22:03:23,160 INFO [M:0;jenkins-hbase9:46805] regionserver.HStore(1080): Added hdfs://localhost:38825/user/jenkins/test-data/09590a21-43cd-f0ed-b0c0-972e05e8154a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6019c4d0349c44ba8ea51e5f8cdae9fe, entries=53, sequenceid=357, filesize=10.4 K 2023-02-11 22:03:23,161 INFO [M:0;jenkins-hbase9:46805] regionserver.HRegion(2947): Finished flush of dataSize ~159.22 KB/163044, heapSize ~192.13 KB/196736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=357, compaction requested=false 2023-02-11 22:03:23,162 INFO [M:0;jenkins-hbase9:46805] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:23,162 DEBUG [M:0;jenkins-hbase9:46805] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153003130Disabling compacts and flushes for region at 1676153003130Disabling writes for close at 1676153003130Obtaining lock to block concurrent updates at 1676153003130Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676153003130Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163044, getHeapSize=196736, getOffHeapSize=0, getCellsCount=442 at 1676153003131 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676153003131Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676153003132 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676153003136 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676153003136Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676153003156 (+20 ms)Finished flush of dataSize ~159.22 KB/163044, heapSize ~192.13 KB/196736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=357, compaction requested=false at 1676153003161 (+5 ms)Writing region close event to WAL at 1676153003162 (+1 ms)Closed at 1676153003162 2023-02-11 22:03:23,167 INFO [M:0;jenkins-hbase9:46805] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 22:03:23,167 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:23,167 INFO [M:0;jenkins-hbase9:46805] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:46805 2023-02-11 22:03:23,171 DEBUG [M:0;jenkins-hbase9:46805] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,46805,1676152988691 already deleted, retry=false 2023-02-11 22:03:23,223 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:23,223 INFO [RS:1;jenkins-hbase9:42223] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,42223,1676152989972; zookeeper connection closed. 2023-02-11 22:03:23,223 ERROR [Listener at localhost/34175-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48839c59 rejected from java.util.concurrent.ThreadPoolExecutor@5d389e53[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:23,223 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@13007e03] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@13007e03 2023-02-11 22:03:23,223 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x1004569c07f0002, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:23,223 ERROR [Listener at localhost/34175-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@303b9fd3 rejected from java.util.concurrent.ThreadPoolExecutor@5d389e53[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:23,223 INFO [Listener at localhost/34175] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 22:03:23,323 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:23,323 INFO [M:0;jenkins-hbase9:46805] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,46805,1676152988691; zookeeper connection closed. 2023-02-11 22:03:23,323 ERROR [Listener at localhost/34175-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@e57deaa rejected from java.util.concurrent.ThreadPoolExecutor@75a0b68f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:23,323 DEBUG [Listener at localhost/34175-EventThread] zookeeper.ZKWatcher(600): master:46805-0x1004569c07f0000, quorum=127.0.0.1:58719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:23,323 ERROR [Listener at localhost/34175-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e523c7c rejected from java.util.concurrent.ThreadPoolExecutor@75a0b68f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:23,325 WARN [Listener at localhost/34175] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:23,328 INFO [Listener at localhost/34175] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:23,431 WARN [BP-630462795-172.31.2.10-1676152985310 heartbeating to localhost/127.0.0.1:38825] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:23,431 WARN [BP-630462795-172.31.2.10-1676152985310 heartbeating to localhost/127.0.0.1:38825] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-630462795-172.31.2.10-1676152985310 (Datanode Uuid 2c0d406b-d90c-4cbb-badf-8f34cc0e16da) service to localhost/127.0.0.1:38825 2023-02-11 22:03:23,433 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/cluster_19036758-f5d2-f16e-2cdf-2f93116bdee6/dfs/data/data3/current/BP-630462795-172.31.2.10-1676152985310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:23,433 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/cluster_19036758-f5d2-f16e-2cdf-2f93116bdee6/dfs/data/data4/current/BP-630462795-172.31.2.10-1676152985310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:23,434 WARN [Listener at localhost/34175] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:23,437 INFO [Listener at localhost/34175] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:23,540 WARN [BP-630462795-172.31.2.10-1676152985310 heartbeating to localhost/127.0.0.1:38825] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:23,541 WARN [BP-630462795-172.31.2.10-1676152985310 heartbeating to localhost/127.0.0.1:38825] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-630462795-172.31.2.10-1676152985310 (Datanode Uuid 34eb48e4-7c43-4a00-9b11-832616aa6c94) service to localhost/127.0.0.1:38825 2023-02-11 22:03:23,542 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/cluster_19036758-f5d2-f16e-2cdf-2f93116bdee6/dfs/data/data1/current/BP-630462795-172.31.2.10-1676152985310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:23,542 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/cluster_19036758-f5d2-f16e-2cdf-2f93116bdee6/dfs/data/data2/current/BP-630462795-172.31.2.10-1676152985310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:23,578 INFO [Listener at localhost/34175] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:23,699 INFO [Listener at localhost/34175] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 22:03:23,765 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 22:03:23,779 INFO [Listener at localhost/34175] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34175 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:38825 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@534902b5 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase9:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:38825 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:38825 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,46805,1676152988691)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:38825 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:38825 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:38825 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38825 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase9:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=532 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 220) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=9935 (was 11009) 2023-02-11 22:03:23,788 INFO [Listener at localhost/34175] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=532, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=166, AvailableMemoryMB=9934 2023-02-11 22:03:23,798 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/hadoop.log.dir so I do NOT create it in target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a 2023-02-11 22:03:23,798 WARN [Listener at localhost/34175] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 22:03:23,798 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/hadoop.tmp.dir so I do NOT create it in target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a 2023-02-11 22:03:23,798 WARN [Listener at localhost/34175] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/599dadc0-ee15-0a50-17c2-a634880507f7/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 22:03:23,798 DEBUG [Listener at localhost/34175] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a 2023-02-11 22:03:23,798 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 22:03:23,798 INFO [Listener at localhost/34175] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/cluster_344e9abb-1122-7a13-ff2c-3137bc719817, deleteOnExit=true 2023-02-11 22:03:23,799 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 22:03:23,799 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/test.cache.data in system properties and HBase conf 2023-02-11 22:03:23,799 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 22:03:23,799 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/hadoop.log.dir in system properties and HBase conf 2023-02-11 22:03:23,799 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 22:03:23,799 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 22:03:23,799 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 22:03:23,799 DEBUG [Listener at localhost/34175] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 22:03:23,800 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:23,800 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:23,800 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 22:03:23,800 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:23,800 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 22:03:23,800 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 22:03:23,800 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:23,800 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:23,800 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 22:03:23,800 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/nfs.dump.dir in system properties and HBase conf 2023-02-11 22:03:23,801 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/java.io.tmpdir in system properties and HBase conf 2023-02-11 22:03:23,801 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:23,801 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 22:03:23,801 INFO [Listener at localhost/34175] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 22:03:23,805 WARN [Listener at localhost/34175] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:23,805 WARN [Listener at localhost/34175] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:23,851 WARN [Listener at localhost/34175] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:23,853 INFO [Listener at localhost/34175] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:23,858 INFO [Listener at localhost/34175] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/java.io.tmpdir/Jetty_localhost_37475_hdfs____.dn1elk/webapp 2023-02-11 22:03:23,954 INFO [Listener at localhost/34175] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37475 2023-02-11 22:03:23,959 WARN [Listener at localhost/34175] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:23,959 WARN [Listener at localhost/34175] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:24,003 WARN [Listener at localhost/44351] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:24,021 WARN [Listener at localhost/44351] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:24,026 WARN [Listener at localhost/44351] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:24,027 INFO [Listener at localhost/44351] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:24,033 INFO [Listener at localhost/44351] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/java.io.tmpdir/Jetty_localhost_35527_datanode____miib27/webapp 2023-02-11 22:03:24,127 INFO [Listener at localhost/44351] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35527 2023-02-11 22:03:24,139 WARN [Listener at localhost/37833] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:24,164 WARN [Listener at localhost/37833] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:24,166 WARN [Listener at localhost/37833] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:24,167 INFO [Listener at localhost/37833] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:24,171 INFO [Listener at localhost/37833] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/java.io.tmpdir/Jetty_localhost_42309_datanode____rdmbdx/webapp 2023-02-11 22:03:24,248 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xec930ba31fc94cdd: Processing first storage report for DS-de92dc54-e206-47e0-9ded-7df84b3cf4a0 from datanode 61e8cdef-2cc8-4a99-9b55-e89c921be14b 2023-02-11 22:03:24,248 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xec930ba31fc94cdd: from storage DS-de92dc54-e206-47e0-9ded-7df84b3cf4a0 node DatanodeRegistration(127.0.0.1:35271, datanodeUuid=61e8cdef-2cc8-4a99-9b55-e89c921be14b, infoPort=36173, infoSecurePort=0, ipcPort=37833, storageInfo=lv=-57;cid=testClusterID;nsid=1399636022;c=1676153003808), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:24,249 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xec930ba31fc94cdd: Processing first storage report for DS-538728be-43e0-4ffe-b342-7146d504dd29 from datanode 61e8cdef-2cc8-4a99-9b55-e89c921be14b 2023-02-11 22:03:24,249 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xec930ba31fc94cdd: from storage DS-538728be-43e0-4ffe-b342-7146d504dd29 node DatanodeRegistration(127.0.0.1:35271, datanodeUuid=61e8cdef-2cc8-4a99-9b55-e89c921be14b, infoPort=36173, infoSecurePort=0, ipcPort=37833, storageInfo=lv=-57;cid=testClusterID;nsid=1399636022;c=1676153003808), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:24,272 INFO [Listener at localhost/37833] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42309 2023-02-11 22:03:24,285 WARN [Listener at localhost/34985] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:24,389 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8cb02025c1c3d0b6: Processing first storage report for DS-382da1dd-e7b6-4c7b-8806-9db36dacc06e from datanode 76d400f0-4a5a-41bc-9485-91a6a083d11c 2023-02-11 22:03:24,389 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8cb02025c1c3d0b6: from storage DS-382da1dd-e7b6-4c7b-8806-9db36dacc06e node DatanodeRegistration(127.0.0.1:38675, datanodeUuid=76d400f0-4a5a-41bc-9485-91a6a083d11c, infoPort=33297, infoSecurePort=0, ipcPort=34985, storageInfo=lv=-57;cid=testClusterID;nsid=1399636022;c=1676153003808), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:24,389 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8cb02025c1c3d0b6: Processing first storage report for DS-3c770948-0a39-4360-bc20-7c70fda99afd from datanode 76d400f0-4a5a-41bc-9485-91a6a083d11c 2023-02-11 22:03:24,389 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8cb02025c1c3d0b6: from storage DS-3c770948-0a39-4360-bc20-7c70fda99afd node DatanodeRegistration(127.0.0.1:38675, datanodeUuid=76d400f0-4a5a-41bc-9485-91a6a083d11c, infoPort=33297, infoSecurePort=0, ipcPort=34985, storageInfo=lv=-57;cid=testClusterID;nsid=1399636022;c=1676153003808), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:24,396 DEBUG [Listener at localhost/34985] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a 2023-02-11 22:03:24,403 INFO [Listener at localhost/34985] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/cluster_344e9abb-1122-7a13-ff2c-3137bc719817/zookeeper_0, clientPort=53876, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/cluster_344e9abb-1122-7a13-ff2c-3137bc719817/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/cluster_344e9abb-1122-7a13-ff2c-3137bc719817/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 22:03:24,406 INFO [Listener at localhost/34985] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53876 2023-02-11 22:03:24,406 INFO [Listener at localhost/34985] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:24,407 INFO [Listener at localhost/34985] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:24,424 INFO [Listener at localhost/34985] util.FSUtils(479): Created version file at hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307 with version=8 2023-02-11 22:03:24,425 INFO [Listener at localhost/34985] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:24,426 INFO [Listener at localhost/34985] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:24,427 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/hbase-staging 2023-02-11 22:03:24,429 INFO [Listener at localhost/34985] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:24,429 INFO [Listener at localhost/34985] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:24,429 INFO [Listener at localhost/34985] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:24,429 INFO [Listener at localhost/34985] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:24,429 INFO [Listener at localhost/34985] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:24,429 INFO [Listener at localhost/34985] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:24,429 INFO [Listener at localhost/34985] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:24,431 INFO [Listener at localhost/34985] ipc.NettyRpcServer(120): Bind to /172.31.2.10:38277 2023-02-11 22:03:24,432 INFO [Listener at localhost/34985] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:24,432 INFO [Listener at localhost/34985] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:24,433 INFO [Listener at localhost/34985] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38277 connecting to ZooKeeper ensemble=127.0.0.1:53876 2023-02-11 22:03:24,443 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:382770x0, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:24,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38277-0x100456a015c0000 connected 2023-02-11 22:03:24,465 DEBUG [Listener at localhost/34985] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:24,466 DEBUG [Listener at localhost/34985] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:24,466 DEBUG [Listener at localhost/34985] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:24,471 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38277 2023-02-11 22:03:24,471 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38277 2023-02-11 22:03:24,472 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38277 2023-02-11 22:03:24,475 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38277 2023-02-11 22:03:24,475 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38277 2023-02-11 22:03:24,476 INFO [Listener at localhost/34985] master.HMaster(439): hbase.rootdir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307, hbase.cluster.distributed=false 2023-02-11 22:03:24,497 INFO [Listener at localhost/34985] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:24,497 INFO [Listener at localhost/34985] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:24,497 INFO [Listener at localhost/34985] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:24,497 INFO [Listener at localhost/34985] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:24,497 INFO [Listener at localhost/34985] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:24,497 INFO [Listener at localhost/34985] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:24,498 INFO [Listener at localhost/34985] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:24,503 INFO [Listener at localhost/34985] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39829 2023-02-11 22:03:24,503 INFO [Listener at localhost/34985] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:24,510 DEBUG [Listener at localhost/34985] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:24,510 INFO [Listener at localhost/34985] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:24,512 INFO [Listener at localhost/34985] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:24,513 INFO [Listener at localhost/34985] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39829 connecting to ZooKeeper ensemble=127.0.0.1:53876 2023-02-11 22:03:24,543 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:398290x0, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:24,545 DEBUG [Listener at localhost/34985] zookeeper.ZKUtil(164): regionserver:398290x0, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:24,545 DEBUG [Listener at localhost/34985] zookeeper.ZKUtil(164): regionserver:398290x0, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:24,546 DEBUG [Listener at localhost/34985] zookeeper.ZKUtil(164): regionserver:398290x0, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:24,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39829-0x100456a015c0001 connected 2023-02-11 22:03:24,599 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39829 2023-02-11 22:03:24,601 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39829 2023-02-11 22:03:24,601 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39829 2023-02-11 22:03:24,601 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39829 2023-02-11 22:03:24,602 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39829 2023-02-11 22:03:24,618 INFO [Listener at localhost/34985] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:24,618 INFO [Listener at localhost/34985] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:24,618 INFO [Listener at localhost/34985] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:24,618 INFO [Listener at localhost/34985] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:24,618 INFO [Listener at localhost/34985] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:24,618 INFO [Listener at localhost/34985] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:24,619 INFO [Listener at localhost/34985] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:24,621 INFO [Listener at localhost/34985] ipc.NettyRpcServer(120): Bind to /172.31.2.10:46823 2023-02-11 22:03:24,621 INFO [Listener at localhost/34985] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:24,627 DEBUG [Listener at localhost/34985] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:24,628 INFO [Listener at localhost/34985] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:24,629 INFO [Listener at localhost/34985] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:24,631 INFO [Listener at localhost/34985] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46823 connecting to ZooKeeper ensemble=127.0.0.1:53876 2023-02-11 22:03:24,638 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:468230x0, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:24,640 DEBUG [Listener at localhost/34985] zookeeper.ZKUtil(164): regionserver:468230x0, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:24,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46823-0x100456a015c0002 connected 2023-02-11 22:03:24,641 DEBUG [Listener at localhost/34985] zookeeper.ZKUtil(164): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:24,641 DEBUG [Listener at localhost/34985] zookeeper.ZKUtil(164): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:24,647 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46823 2023-02-11 22:03:24,649 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46823 2023-02-11 22:03:24,652 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46823 2023-02-11 22:03:24,659 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46823 2023-02-11 22:03:24,659 DEBUG [Listener at localhost/34985] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46823 2023-02-11 22:03:24,661 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,38277,1676153004428 2023-02-11 22:03:24,663 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:24,664 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,38277,1676153004428 2023-02-11 22:03:24,665 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:24,667 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:24,667 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:24,667 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:24,668 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:24,669 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,38277,1676153004428 from backup master directory 2023-02-11 22:03:24,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:24,672 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:24,672 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,38277,1676153004428 2023-02-11 22:03:24,672 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,38277,1676153004428 2023-02-11 22:03:24,672 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:24,736 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/hbase.id with ID: 42fd8c2a-be8a-4f91-a630-fe74cd03ee02 2023-02-11 22:03:24,755 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:24,758 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:24,816 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6e541e1d to 127.0.0.1:53876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:24,847 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b74f3e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:24,848 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:24,848 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 22:03:24,851 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:24,853 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/data/master/store-tmp 2023-02-11 22:03:24,903 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:24,904 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:24,904 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:24,904 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:24,904 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:24,904 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:24,904 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:24,904 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153004904Disabling compacts and flushes for region at 1676153004904Disabling writes for close at 1676153004904Writing region close event to WAL at 1676153004904Closed at 1676153004904 2023-02-11 22:03:24,905 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/WALs/jenkins-hbase9.apache.org,38277,1676153004428 2023-02-11 22:03:24,908 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38277%2C1676153004428, suffix=, logDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/WALs/jenkins-hbase9.apache.org,38277,1676153004428, archiveDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/oldWALs, maxLogs=10 2023-02-11 22:03:24,935 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35271,DS-de92dc54-e206-47e0-9ded-7df84b3cf4a0,DISK] 2023-02-11 22:03:24,939 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38675,DS-382da1dd-e7b6-4c7b-8806-9db36dacc06e,DISK] 2023-02-11 22:03:24,978 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/WALs/jenkins-hbase9.apache.org,38277,1676153004428/jenkins-hbase9.apache.org%2C38277%2C1676153004428.1676153004909 2023-02-11 22:03:24,978 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35271,DS-de92dc54-e206-47e0-9ded-7df84b3cf4a0,DISK], DatanodeInfoWithStorage[127.0.0.1:38675,DS-382da1dd-e7b6-4c7b-8806-9db36dacc06e,DISK]] 2023-02-11 22:03:24,978 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:24,978 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:24,978 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:24,978 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:24,987 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:24,989 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 22:03:24,990 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 22:03:24,991 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:24,992 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:24,999 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:25,007 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:25,012 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:25,013 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59421031, jitterRate=-0.11455763876438141}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:25,013 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676153004978Initializing all the Stores at 1676153004980 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153004980Cleaning up temporary data from old regions at 1676153004999 (+19 ms)Cleaning up detritus from prior splits at 1676153005000 (+1 ms)Region opened successfully at 1676153005013 (+13 ms) 2023-02-11 22:03:25,015 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 22:03:25,016 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 22:03:25,016 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 22:03:25,016 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 22:03:25,017 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 22:03:25,017 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 22:03:25,017 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 22:03:25,029 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 22:03:25,030 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 22:03:25,044 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 22:03:25,044 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 22:03:25,045 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 22:03:25,045 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 22:03:25,046 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 22:03:25,061 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:25,061 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 22:03:25,062 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 22:03:25,063 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 22:03:25,065 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:25,065 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:25,066 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:25,066 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:25,066 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,38277,1676153004428, sessionid=0x100456a015c0000, setting cluster-up flag (Was=false) 2023-02-11 22:03:25,071 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:25,079 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 22:03:25,084 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,38277,1676153004428 2023-02-11 22:03:25,093 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:25,102 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 22:03:25,103 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,38277,1676153004428 2023-02-11 22:03:25,104 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.hbase-snapshot/.tmp 2023-02-11 22:03:25,108 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:25,109 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:25,109 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:25,109 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:25,109 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:25,109 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-11 22:03:25,109 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,109 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:25,109 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,118 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676153035118 2023-02-11 22:03:25,118 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 22:03:25,118 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 22:03:25,119 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 22:03:25,119 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 22:03:25,119 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 22:03:25,119 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 22:03:25,123 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,123 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:25,123 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 22:03:25,123 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 22:03:25,123 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 22:03:25,123 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 22:03:25,125 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:25,128 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 22:03:25,128 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 22:03:25,128 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153005128,5,FailOnTimeoutGroup] 2023-02-11 22:03:25,131 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153005128,5,FailOnTimeoutGroup] 2023-02-11 22:03:25,131 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,139 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 22:03:25,139 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,139 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,151 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:25,152 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:25,152 INFO [PEWorker-2] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307 2023-02-11 22:03:25,162 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(952): ClusterId : 42fd8c2a-be8a-4f91-a630-fe74cd03ee02 2023-02-11 22:03:25,162 DEBUG [RS:0;jenkins-hbase9:39829] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:25,165 DEBUG [PEWorker-2] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:25,165 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(952): ClusterId : 42fd8c2a-be8a-4f91-a630-fe74cd03ee02 2023-02-11 22:03:25,165 DEBUG [RS:1;jenkins-hbase9:46823] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:25,166 DEBUG [RS:0;jenkins-hbase9:39829] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:25,166 DEBUG [RS:0;jenkins-hbase9:39829] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:25,167 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:25,168 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/info 2023-02-11 22:03:25,169 DEBUG [RS:0;jenkins-hbase9:39829] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:25,171 DEBUG [RS:1;jenkins-hbase9:46823] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:25,171 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:25,171 DEBUG [RS:0;jenkins-hbase9:39829] zookeeper.ReadOnlyZKClient(139): Connect 0x3a50219d to 127.0.0.1:53876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:25,171 DEBUG [RS:1;jenkins-hbase9:46823] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:25,172 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:25,172 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:25,173 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:25,174 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:25,174 DEBUG [RS:1;jenkins-hbase9:46823] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:25,174 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:25,174 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:25,176 DEBUG [RS:1;jenkins-hbase9:46823] zookeeper.ReadOnlyZKClient(139): Connect 0x5ef25f25 to 127.0.0.1:53876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:25,177 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/table 2023-02-11 22:03:25,177 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:25,178 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:25,185 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740 2023-02-11 22:03:25,185 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740 2023-02-11 22:03:25,195 DEBUG [RS:0;jenkins-hbase9:39829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3497d8a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:25,195 DEBUG [RS:0;jenkins-hbase9:39829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30a84aed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:25,199 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:25,208 DEBUG [PEWorker-2] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:25,209 DEBUG [RS:0;jenkins-hbase9:39829] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:39829 2023-02-11 22:03:25,209 INFO [RS:0;jenkins-hbase9:39829] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:25,209 INFO [RS:0;jenkins-hbase9:39829] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:25,210 DEBUG [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:25,210 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,38277,1676153004428 with isa=jenkins-hbase9.apache.org/172.31.2.10:39829, startcode=1676153004496 2023-02-11 22:03:25,210 DEBUG [RS:0;jenkins-hbase9:39829] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:25,211 DEBUG [RS:1;jenkins-hbase9:46823] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5035aa8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:25,211 DEBUG [RS:1;jenkins-hbase9:46823] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@540a3455, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:25,211 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:25,212 INFO [PEWorker-2] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63250505, jitterRate=-0.05749402940273285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:25,212 DEBUG [PEWorker-2] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676153005165Initializing all the Stores at 1676153005166 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153005166Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153005166Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153005166Cleaning up temporary data from old regions at 1676153005186 (+20 ms)Cleaning up detritus from prior splits at 1676153005187 (+1 ms)Region opened successfully at 1676153005212 (+25 ms) 2023-02-11 22:03:25,212 DEBUG [PEWorker-2] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:25,212 INFO [PEWorker-2] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:25,212 DEBUG [PEWorker-2] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:25,212 DEBUG [PEWorker-2] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:25,212 DEBUG [PEWorker-2] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:25,215 INFO [PEWorker-2] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:25,216 DEBUG [PEWorker-2] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153005212Disabling compacts and flushes for region at 1676153005212Disabling writes for close at 1676153005212Writing region close event to WAL at 1676153005215 (+3 ms)Closed at 1676153005215 2023-02-11 22:03:25,217 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45939, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:25,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:25,219 DEBUG [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307 2023-02-11 22:03:25,219 DEBUG [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44351 2023-02-11 22:03:25,219 DEBUG [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:25,221 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:25,222 DEBUG [RS:0;jenkins-hbase9:39829] zookeeper.ZKUtil(162): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:25,222 WARN [RS:0;jenkins-hbase9:39829] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:25,222 INFO [RS:0;jenkins-hbase9:39829] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:25,223 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,39829,1676153004496] 2023-02-11 22:03:25,223 DEBUG [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/WALs/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:25,225 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:25,225 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 22:03:25,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 22:03:25,226 DEBUG [RS:1;jenkins-hbase9:46823] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:46823 2023-02-11 22:03:25,226 INFO [RS:1;jenkins-hbase9:46823] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:25,226 INFO [RS:1;jenkins-hbase9:46823] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:25,226 DEBUG [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:25,228 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 22:03:25,229 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,38277,1676153004428 with isa=jenkins-hbase9.apache.org/172.31.2.10:46823, startcode=1676153004617 2023-02-11 22:03:25,229 DEBUG [RS:1;jenkins-hbase9:46823] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:25,230 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 22:03:25,236 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48211, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:25,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:25,237 DEBUG [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307 2023-02-11 22:03:25,237 DEBUG [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44351 2023-02-11 22:03:25,237 DEBUG [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:25,239 DEBUG [RS:0;jenkins-hbase9:39829] zookeeper.ZKUtil(162): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:25,242 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:25,242 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:25,243 DEBUG [RS:1;jenkins-hbase9:46823] zookeeper.ZKUtil(162): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:25,243 WARN [RS:1;jenkins-hbase9:46823] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:25,243 INFO [RS:1;jenkins-hbase9:46823] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:25,243 DEBUG [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/WALs/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:25,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:25,246 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,46823,1676153004617] 2023-02-11 22:03:25,247 DEBUG [RS:0;jenkins-hbase9:39829] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:25,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:25,247 INFO [RS:0;jenkins-hbase9:39829] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:25,249 INFO [RS:0;jenkins-hbase9:39829] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:25,252 DEBUG [RS:1;jenkins-hbase9:46823] zookeeper.ZKUtil(162): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:25,252 DEBUG [RS:1;jenkins-hbase9:46823] zookeeper.ZKUtil(162): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:25,253 DEBUG [RS:1;jenkins-hbase9:46823] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:25,254 INFO [RS:1;jenkins-hbase9:46823] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:25,255 INFO [RS:0;jenkins-hbase9:39829] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:25,255 INFO [RS:0;jenkins-hbase9:39829] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,259 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:25,260 INFO [RS:1;jenkins-hbase9:46823] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:25,267 INFO [RS:0;jenkins-hbase9:39829] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,267 INFO [RS:1;jenkins-hbase9:46823] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:25,267 INFO [RS:1;jenkins-hbase9:46823] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,267 DEBUG [RS:0;jenkins-hbase9:39829] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,267 DEBUG [RS:0;jenkins-hbase9:39829] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,267 DEBUG [RS:0;jenkins-hbase9:39829] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,267 DEBUG [RS:0;jenkins-hbase9:39829] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,267 DEBUG [RS:0;jenkins-hbase9:39829] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,268 DEBUG [RS:0;jenkins-hbase9:39829] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:25,268 DEBUG [RS:0;jenkins-hbase9:39829] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,268 DEBUG [RS:0;jenkins-hbase9:39829] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,268 DEBUG [RS:0;jenkins-hbase9:39829] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,268 DEBUG [RS:0;jenkins-hbase9:39829] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,270 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:25,279 INFO [RS:0;jenkins-hbase9:39829] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,279 INFO [RS:1;jenkins-hbase9:46823] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,279 INFO [RS:0;jenkins-hbase9:39829] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,279 INFO [RS:0;jenkins-hbase9:39829] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,279 DEBUG [RS:1;jenkins-hbase9:46823] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,279 DEBUG [RS:1;jenkins-hbase9:46823] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,279 DEBUG [RS:1;jenkins-hbase9:46823] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,279 DEBUG [RS:1;jenkins-hbase9:46823] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,280 DEBUG [RS:1;jenkins-hbase9:46823] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,280 DEBUG [RS:1;jenkins-hbase9:46823] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:25,280 DEBUG [RS:1;jenkins-hbase9:46823] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,280 DEBUG [RS:1;jenkins-hbase9:46823] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,280 DEBUG [RS:1;jenkins-hbase9:46823] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,280 DEBUG [RS:1;jenkins-hbase9:46823] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:25,295 INFO [RS:1;jenkins-hbase9:46823] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,295 INFO [RS:1;jenkins-hbase9:46823] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,295 INFO [RS:1;jenkins-hbase9:46823] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,303 INFO [RS:0;jenkins-hbase9:39829] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:25,303 INFO [RS:0;jenkins-hbase9:39829] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39829,1676153004496-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,313 INFO [RS:1;jenkins-hbase9:46823] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:25,313 INFO [RS:1;jenkins-hbase9:46823] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,46823,1676153004617-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,331 INFO [RS:0;jenkins-hbase9:39829] regionserver.Replication(203): jenkins-hbase9.apache.org,39829,1676153004496 started 2023-02-11 22:03:25,332 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,39829,1676153004496, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:39829, sessionid=0x100456a015c0001 2023-02-11 22:03:25,332 INFO [RS:1;jenkins-hbase9:46823] regionserver.Replication(203): jenkins-hbase9.apache.org,46823,1676153004617 started 2023-02-11 22:03:25,332 DEBUG [RS:0;jenkins-hbase9:39829] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:25,332 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,46823,1676153004617, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:46823, sessionid=0x100456a015c0002 2023-02-11 22:03:25,332 DEBUG [RS:0;jenkins-hbase9:39829] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:25,332 DEBUG [RS:1;jenkins-hbase9:46823] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:25,332 DEBUG [RS:1;jenkins-hbase9:46823] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:25,332 DEBUG [RS:1;jenkins-hbase9:46823] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46823,1676153004617' 2023-02-11 22:03:25,332 DEBUG [RS:1;jenkins-hbase9:46823] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:25,332 DEBUG [RS:0;jenkins-hbase9:39829] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39829,1676153004496' 2023-02-11 22:03:25,332 DEBUG [RS:0;jenkins-hbase9:39829] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:25,333 DEBUG [RS:1;jenkins-hbase9:46823] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:25,334 DEBUG [RS:0;jenkins-hbase9:39829] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:25,334 DEBUG [RS:1;jenkins-hbase9:46823] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:25,334 DEBUG [RS:1;jenkins-hbase9:46823] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:25,334 DEBUG [RS:1;jenkins-hbase9:46823] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:25,334 DEBUG [RS:1;jenkins-hbase9:46823] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46823,1676153004617' 2023-02-11 22:03:25,334 DEBUG [RS:0;jenkins-hbase9:39829] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:25,334 DEBUG [RS:1;jenkins-hbase9:46823] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:25,334 DEBUG [RS:0;jenkins-hbase9:39829] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:25,334 DEBUG [RS:0;jenkins-hbase9:39829] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:25,334 DEBUG [RS:0;jenkins-hbase9:39829] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39829,1676153004496' 2023-02-11 22:03:25,334 DEBUG [RS:0;jenkins-hbase9:39829] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:25,334 DEBUG [RS:1;jenkins-hbase9:46823] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:25,335 DEBUG [RS:0;jenkins-hbase9:39829] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:25,335 DEBUG [RS:1;jenkins-hbase9:46823] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:25,335 INFO [RS:1;jenkins-hbase9:46823] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:25,335 INFO [RS:1;jenkins-hbase9:46823] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:25,335 DEBUG [RS:0;jenkins-hbase9:39829] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:25,335 INFO [RS:0;jenkins-hbase9:39829] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:25,335 INFO [RS:0;jenkins-hbase9:39829] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:25,380 DEBUG [jenkins-hbase9:38277] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 22:03:25,380 DEBUG [jenkins-hbase9:38277] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:25,382 DEBUG [jenkins-hbase9:38277] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:25,382 DEBUG [jenkins-hbase9:38277] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:25,382 DEBUG [jenkins-hbase9:38277] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:25,383 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,39829,1676153004496, state=OPENING 2023-02-11 22:03:25,386 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 22:03:25,387 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:25,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,39829,1676153004496}] 2023-02-11 22:03:25,387 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:25,542 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:25,542 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 22:03:25,545 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58842, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 22:03:25,550 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 22:03:25,550 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:25,551 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39829%2C1676153004496.meta, suffix=.meta, logDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/WALs/jenkins-hbase9.apache.org,39829,1676153004496, archiveDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/oldWALs, maxLogs=32 2023-02-11 22:03:25,576 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35271,DS-de92dc54-e206-47e0-9ded-7df84b3cf4a0,DISK] 2023-02-11 22:03:25,576 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38675,DS-382da1dd-e7b6-4c7b-8806-9db36dacc06e,DISK] 2023-02-11 22:03:25,579 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/WALs/jenkins-hbase9.apache.org,39829,1676153004496/jenkins-hbase9.apache.org%2C39829%2C1676153004496.meta.1676153005553.meta 2023-02-11 22:03:25,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35271,DS-de92dc54-e206-47e0-9ded-7df84b3cf4a0,DISK], DatanodeInfoWithStorage[127.0.0.1:38675,DS-382da1dd-e7b6-4c7b-8806-9db36dacc06e,DISK]] 2023-02-11 22:03:25,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:25,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 22:03:25,580 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 22:03:25,580 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 22:03:25,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 22:03:25,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:25,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 22:03:25,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 22:03:25,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:25,587 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/info 2023-02-11 22:03:25,587 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/info 2023-02-11 22:03:25,587 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:25,588 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:25,588 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:25,589 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:25,590 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:25,590 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:25,591 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:25,591 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:25,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/table 2023-02-11 22:03:25,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/table 2023-02-11 22:03:25,592 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:25,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:25,594 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740 2023-02-11 22:03:25,595 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740 2023-02-11 22:03:25,598 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:25,600 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:25,601 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73376698, jitterRate=0.09339800477027893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:25,601 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676153005581Writing region info on filesystem at 1676153005581Initializing all the Stores at 1676153005584 (+3 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153005584Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153005585 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153005585Cleaning up temporary data from old regions at 1676153005596 (+11 ms)Cleaning up detritus from prior splits at 1676153005596Running coprocessor post-open hooks at 1676153005601 (+5 ms)Region opened successfully at 1676153005601 2023-02-11 22:03:25,602 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676153005542 2023-02-11 22:03:25,607 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 22:03:25,607 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 22:03:25,608 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,39829,1676153004496, state=OPEN 2023-02-11 22:03:25,609 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 22:03:25,609 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:25,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 22:03:25,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,39829,1676153004496 in 222 msec 2023-02-11 22:03:25,614 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 22:03:25,614 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 387 msec 2023-02-11 22:03:25,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 508 msec 2023-02-11 22:03:25,617 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676153004664, completionTime=-1 2023-02-11 22:03:25,617 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 22:03:25,617 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 22:03:25,620 DEBUG [hconnection-0x3b14079e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:25,623 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58848, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:25,625 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 22:03:25,625 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676153065625 2023-02-11 22:03:25,625 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676153125625 2023-02-11 22:03:25,625 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-11 22:03:25,637 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38277,1676153004428-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,638 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38277,1676153004428-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,638 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38277,1676153004428-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,638 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:38277, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,638 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:25,638 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 22:03:25,638 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:25,639 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 22:03:25,640 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 22:03:25,641 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:25,642 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:25,644 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/hbase/namespace/486c71946d36ff5e4572900863d06748 2023-02-11 22:03:25,644 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/hbase/namespace/486c71946d36ff5e4572900863d06748 empty. 2023-02-11 22:03:25,645 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/hbase/namespace/486c71946d36ff5e4572900863d06748 2023-02-11 22:03:25,645 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 22:03:25,658 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:25,660 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 486c71946d36ff5e4572900863d06748, NAME => 'hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp 2023-02-11 22:03:25,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:25,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 486c71946d36ff5e4572900863d06748, disabling compactions & flushes 2023-02-11 22:03:25,677 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. 2023-02-11 22:03:25,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. 2023-02-11 22:03:25,678 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. after waiting 0 ms 2023-02-11 22:03:25,678 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. 2023-02-11 22:03:25,678 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. 2023-02-11 22:03:25,678 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 486c71946d36ff5e4572900863d06748: Waiting for close lock at 1676153005677Disabling compacts and flushes for region at 1676153005677Disabling writes for close at 1676153005678 (+1 ms)Writing region close event to WAL at 1676153005678Closed at 1676153005678 2023-02-11 22:03:25,680 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:25,681 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153005681"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153005681"}]},"ts":"1676153005681"} 2023-02-11 22:03:25,684 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 22:03:25,685 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:25,686 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153005685"}]},"ts":"1676153005685"} 2023-02-11 22:03:25,687 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 22:03:25,691 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:25,691 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:25,691 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:25,691 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:25,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=486c71946d36ff5e4572900863d06748, ASSIGN}] 2023-02-11 22:03:25,694 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=486c71946d36ff5e4572900863d06748, ASSIGN 2023-02-11 22:03:25,695 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=486c71946d36ff5e4572900863d06748, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46823,1676153004617; forceNewPlan=false, retain=false 2023-02-11 22:03:25,845 INFO [jenkins-hbase9:38277] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 22:03:25,846 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=486c71946d36ff5e4572900863d06748, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:25,846 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153005846"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153005846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153005846"}]},"ts":"1676153005846"} 2023-02-11 22:03:25,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 486c71946d36ff5e4572900863d06748, server=jenkins-hbase9.apache.org,46823,1676153004617}] 2023-02-11 22:03:26,002 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:26,002 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 22:03:26,005 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40802, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 22:03:26,010 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. 2023-02-11 22:03:26,011 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C46823%2C1676153004617, suffix=, logDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/WALs/jenkins-hbase9.apache.org,46823,1676153004617, archiveDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/oldWALs, maxLogs=32 2023-02-11 22:03:26,031 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38675,DS-382da1dd-e7b6-4c7b-8806-9db36dacc06e,DISK] 2023-02-11 22:03:26,031 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35271,DS-de92dc54-e206-47e0-9ded-7df84b3cf4a0,DISK] 2023-02-11 22:03:26,034 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/WALs/jenkins-hbase9.apache.org,46823,1676153004617/jenkins-hbase9.apache.org%2C46823%2C1676153004617.1676153006012 2023-02-11 22:03:26,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38675,DS-382da1dd-e7b6-4c7b-8806-9db36dacc06e,DISK], DatanodeInfoWithStorage[127.0.0.1:35271,DS-de92dc54-e206-47e0-9ded-7df84b3cf4a0,DISK]] 2023-02-11 22:03:26,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 486c71946d36ff5e4572900863d06748, NAME => 'hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:26,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 486c71946d36ff5e4572900863d06748 2023-02-11 22:03:26,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 486c71946d36ff5e4572900863d06748 2023-02-11 22:03:26,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 486c71946d36ff5e4572900863d06748 2023-02-11 22:03:26,043 INFO [StoreOpener-486c71946d36ff5e4572900863d06748-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 486c71946d36ff5e4572900863d06748 2023-02-11 22:03:26,044 DEBUG [StoreOpener-486c71946d36ff5e4572900863d06748-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/namespace/486c71946d36ff5e4572900863d06748/info 2023-02-11 22:03:26,044 DEBUG [StoreOpener-486c71946d36ff5e4572900863d06748-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/namespace/486c71946d36ff5e4572900863d06748/info 2023-02-11 22:03:26,045 INFO [StoreOpener-486c71946d36ff5e4572900863d06748-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 486c71946d36ff5e4572900863d06748 columnFamilyName info 2023-02-11 22:03:26,045 INFO [StoreOpener-486c71946d36ff5e4572900863d06748-1] regionserver.HStore(310): Store=486c71946d36ff5e4572900863d06748/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/namespace/486c71946d36ff5e4572900863d06748 2023-02-11 22:03:26,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/namespace/486c71946d36ff5e4572900863d06748 2023-02-11 22:03:26,050 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 486c71946d36ff5e4572900863d06748 2023-02-11 22:03:26,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/namespace/486c71946d36ff5e4572900863d06748/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:26,053 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 486c71946d36ff5e4572900863d06748; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67974402, jitterRate=0.012897521257400513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:26,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 486c71946d36ff5e4572900863d06748: Running coprocessor pre-open hook at 1676153006035Writing region info on filesystem at 1676153006035Initializing all the Stores at 1676153006036 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153006036Cleaning up temporary data from old regions at 1676153006048 (+12 ms)Cleaning up detritus from prior splits at 1676153006048Running coprocessor post-open hooks at 1676153006053 (+5 ms)Region opened successfully at 1676153006053 2023-02-11 22:03:26,054 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748., pid=6, masterSystemTime=1676153006002 2023-02-11 22:03:26,058 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. 2023-02-11 22:03:26,058 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. 2023-02-11 22:03:26,058 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=486c71946d36ff5e4572900863d06748, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:26,059 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153006058"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153006058"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153006058"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153006058"}]},"ts":"1676153006058"} 2023-02-11 22:03:26,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 22:03:26,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 486c71946d36ff5e4572900863d06748, server=jenkins-hbase9.apache.org,46823,1676153004617 in 211 msec 2023-02-11 22:03:26,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 22:03:26,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=486c71946d36ff5e4572900863d06748, ASSIGN in 377 msec 2023-02-11 22:03:26,072 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:26,072 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153006072"}]},"ts":"1676153006072"} 2023-02-11 22:03:26,074 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 22:03:26,077 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:26,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 439 msec 2023-02-11 22:03:26,140 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 22:03:26,144 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:26,144 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:26,147 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:26,150 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40808, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:26,152 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 22:03:26,161 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:26,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-11 22:03:26,174 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 22:03:26,181 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:26,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-11 22:03:26,198 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 22:03:26,201 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 22:03:26,201 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.529sec 2023-02-11 22:03:26,201 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 22:03:26,201 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 22:03:26,201 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 22:03:26,201 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38277,1676153004428-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 22:03:26,201 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38277,1676153004428-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 22:03:26,203 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 22:03:26,265 DEBUG [Listener at localhost/34985] zookeeper.ReadOnlyZKClient(139): Connect 0x33fff870 to 127.0.0.1:53876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:26,270 DEBUG [Listener at localhost/34985] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@582f693, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:26,272 DEBUG [hconnection-0x789ebc49-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:26,273 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58852, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:26,275 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,38277,1676153004428 2023-02-11 22:03:26,275 DEBUG [Listener at localhost/34985] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 22:03:26,279 DEBUG [Listener at localhost/34985] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 22:03:26,281 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60808, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 22:03:26,281 INFO [Listener at localhost/34985] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 22:03:26,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-11 22:03:26,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 22:03:26,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.2.10:60808 deadline: 1676153066282, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-11 22:03:26,283 INFO [Listener at localhost/34985] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-11 22:03:26,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:26,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-11 22:03:26,289 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:26,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-11 22:03:26,289 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:26,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:26,300 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:26,300 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:26,300 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:26,300 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:26,300 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:26,300 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:26,300 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:26,301 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839 empty. 2023-02-11 22:03:26,300 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:26,301 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152 empty. 2023-02-11 22:03:26,301 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e empty. 2023-02-11 22:03:26,301 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b empty. 2023-02-11 22:03:26,301 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9 empty. 2023-02-11 22:03:26,301 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba empty. 2023-02-11 22:03:26,301 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4 empty. 2023-02-11 22:03:26,301 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:26,301 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:26,302 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:26,302 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86 empty. 2023-02-11 22:03:26,302 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:26,302 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336 empty. 2023-02-11 22:03:26,302 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:26,302 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:26,303 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:26,303 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:26,303 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:26,303 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:26,303 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:26,303 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645 empty. 2023-02-11 22:03:26,304 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:26,304 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 22:03:26,316 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:26,317 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 12b8f2259ac6e3ab0ee8ddf4b01c4b9e, NAME => 'testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp 2023-02-11 22:03:26,318 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => fe57fb58d8f76892415e2213259fe152, NAME => 'testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp 2023-02-11 22:03:26,318 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c8679eb44c4f2cd6567038643bfd5839, NAME => 'testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp 2023-02-11 22:03:26,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 12b8f2259ac6e3ab0ee8ddf4b01c4b9e, disabling compactions & flushes 2023-02-11 22:03:26,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c8679eb44c4f2cd6567038643bfd5839, disabling compactions & flushes 2023-02-11 22:03:26,330 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:26,330 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:26,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:26,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:26,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. after waiting 0 ms 2023-02-11 22:03:26,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:26,331 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:26,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e: Waiting for close lock at 1676153006330Disabling compacts and flushes for region at 1676153006330Disabling writes for close at 1676153006331 (+1 ms)Writing region close event to WAL at 1676153006331Closed at 1676153006331 2023-02-11 22:03:26,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. after waiting 0 ms 2023-02-11 22:03:26,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:26,331 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:26,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c8679eb44c4f2cd6567038643bfd5839: Waiting for close lock at 1676153006330Disabling compacts and flushes for region at 1676153006330Disabling writes for close at 1676153006331 (+1 ms)Writing region close event to WAL at 1676153006331Closed at 1676153006331 2023-02-11 22:03:26,332 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f69c06b1b31a25e7c17175f781c3185b, NAME => 'testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp 2023-02-11 22:03:26,332 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 00feacf3c0d364343957248be8b643ba, NAME => 'testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp 2023-02-11 22:03:26,337 INFO [RS:0;jenkins-hbase9:39829] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39829%2C1676153004496, suffix=, logDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/WALs/jenkins-hbase9.apache.org,39829,1676153004496, archiveDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/oldWALs, maxLogs=32 2023-02-11 22:03:26,347 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,348 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing fe57fb58d8f76892415e2213259fe152, disabling compactions & flushes 2023-02-11 22:03:26,348 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:26,348 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:26,348 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. after waiting 0 ms 2023-02-11 22:03:26,348 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:26,348 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:26,348 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for fe57fb58d8f76892415e2213259fe152: Waiting for close lock at 1676153006348Disabling compacts and flushes for region at 1676153006348Disabling writes for close at 1676153006348Writing region close event to WAL at 1676153006348Closed at 1676153006348 2023-02-11 22:03:26,348 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 729a58db7fb4592c77e2cc4df3adde86, NAME => 'testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp 2023-02-11 22:03:26,350 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,350 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f69c06b1b31a25e7c17175f781c3185b, disabling compactions & flushes 2023-02-11 22:03:26,350 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:26,350 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:26,350 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. after waiting 0 ms 2023-02-11 22:03:26,350 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:26,350 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:26,350 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f69c06b1b31a25e7c17175f781c3185b: Waiting for close lock at 1676153006350Disabling compacts and flushes for region at 1676153006350Disabling writes for close at 1676153006350Writing region close event to WAL at 1676153006350Closed at 1676153006350 2023-02-11 22:03:26,401 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1831fcd6b7e2a5995e84df12185098d9, NAME => 'testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp 2023-02-11 22:03:26,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:26,417 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35271,DS-de92dc54-e206-47e0-9ded-7df84b3cf4a0,DISK] 2023-02-11 22:03:26,417 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,417 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 00feacf3c0d364343957248be8b643ba, disabling compactions & flushes 2023-02-11 22:03:26,417 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:26,417 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:26,417 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. after waiting 0 ms 2023-02-11 22:03:26,417 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:26,417 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:26,417 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 00feacf3c0d364343957248be8b643ba: Waiting for close lock at 1676153006417Disabling compacts and flushes for region at 1676153006417Disabling writes for close at 1676153006417Writing region close event to WAL at 1676153006417Closed at 1676153006417 2023-02-11 22:03:26,417 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38675,DS-382da1dd-e7b6-4c7b-8806-9db36dacc06e,DISK] 2023-02-11 22:03:26,418 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => cb70f48b8da268def615f833e60d23f4, NAME => 'testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp 2023-02-11 22:03:26,420 INFO [RS:0;jenkins-hbase9:39829] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/WALs/jenkins-hbase9.apache.org,39829,1676153004496/jenkins-hbase9.apache.org%2C39829%2C1676153004496.1676153006338 2023-02-11 22:03:26,423 DEBUG [RS:0;jenkins-hbase9:39829] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35271,DS-de92dc54-e206-47e0-9ded-7df84b3cf4a0,DISK], DatanodeInfoWithStorage[127.0.0.1:38675,DS-382da1dd-e7b6-4c7b-8806-9db36dacc06e,DISK]] 2023-02-11 22:03:26,427 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,427 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 729a58db7fb4592c77e2cc4df3adde86, disabling compactions & flushes 2023-02-11 22:03:26,427 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:26,427 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:26,427 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. after waiting 0 ms 2023-02-11 22:03:26,428 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:26,428 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:26,428 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 729a58db7fb4592c77e2cc4df3adde86: Waiting for close lock at 1676153006427Disabling compacts and flushes for region at 1676153006427Disabling writes for close at 1676153006428 (+1 ms)Writing region close event to WAL at 1676153006428Closed at 1676153006428 2023-02-11 22:03:26,428 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => a12cce4691f2804e26ca94cccb4c0336, NAME => 'testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp 2023-02-11 22:03:26,429 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,429 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 1831fcd6b7e2a5995e84df12185098d9, disabling compactions & flushes 2023-02-11 22:03:26,429 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:26,429 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:26,429 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. after waiting 0 ms 2023-02-11 22:03:26,429 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:26,430 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:26,430 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 1831fcd6b7e2a5995e84df12185098d9: Waiting for close lock at 1676153006429Disabling compacts and flushes for region at 1676153006429Disabling writes for close at 1676153006429Writing region close event to WAL at 1676153006430 (+1 ms)Closed at 1676153006430 2023-02-11 22:03:26,430 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c9c7af6c79927f83f8f93a4b2e508645, NAME => 'testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.tmp 2023-02-11 22:03:26,433 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,433 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing cb70f48b8da268def615f833e60d23f4, disabling compactions & flushes 2023-02-11 22:03:26,433 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:26,433 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:26,433 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. after waiting 0 ms 2023-02-11 22:03:26,433 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:26,433 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:26,433 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for cb70f48b8da268def615f833e60d23f4: Waiting for close lock at 1676153006433Disabling compacts and flushes for region at 1676153006433Disabling writes for close at 1676153006433Writing region close event to WAL at 1676153006433Closed at 1676153006433 2023-02-11 22:03:26,439 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,439 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing a12cce4691f2804e26ca94cccb4c0336, disabling compactions & flushes 2023-02-11 22:03:26,439 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,439 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:26,439 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c9c7af6c79927f83f8f93a4b2e508645, disabling compactions & flushes 2023-02-11 22:03:26,439 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:26,439 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:26,439 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. after waiting 0 ms 2023-02-11 22:03:26,439 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:26,439 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:26,439 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. after waiting 0 ms 2023-02-11 22:03:26,439 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:26,439 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:26,440 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:26,440 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for a12cce4691f2804e26ca94cccb4c0336: Waiting for close lock at 1676153006439Disabling compacts and flushes for region at 1676153006439Disabling writes for close at 1676153006439Writing region close event to WAL at 1676153006439Closed at 1676153006439 2023-02-11 22:03:26,440 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c9c7af6c79927f83f8f93a4b2e508645: Waiting for close lock at 1676153006439Disabling compacts and flushes for region at 1676153006439Disabling writes for close at 1676153006439Writing region close event to WAL at 1676153006440 (+1 ms)Closed at 1676153006440 2023-02-11 22:03:26,443 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:26,445 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153006444"}]},"ts":"1676153006444"} 2023-02-11 22:03:26,445 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676153006444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153006444"}]},"ts":"1676153006444"} 2023-02-11 22:03:26,445 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153006444"}]},"ts":"1676153006444"} 2023-02-11 22:03:26,445 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153006444"}]},"ts":"1676153006444"} 2023-02-11 22:03:26,445 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676153006285.00feacf3c0d364343957248be8b643ba.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153006444"}]},"ts":"1676153006444"} 2023-02-11 22:03:26,445 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153006444"}]},"ts":"1676153006444"} 2023-02-11 22:03:26,445 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153006444"}]},"ts":"1676153006444"} 2023-02-11 22:03:26,445 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153006444"}]},"ts":"1676153006444"} 2023-02-11 22:03:26,446 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153006444"}]},"ts":"1676153006444"} 2023-02-11 22:03:26,446 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676153006444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153006444"}]},"ts":"1676153006444"} 2023-02-11 22:03:26,449 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-11 22:03:26,450 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:26,450 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153006450"}]},"ts":"1676153006450"} 2023-02-11 22:03:26,452 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-11 22:03:26,455 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:26,463 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:26,463 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:26,463 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:26,464 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c8679eb44c4f2cd6567038643bfd5839, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fe57fb58d8f76892415e2213259fe152, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=12b8f2259ac6e3ab0ee8ddf4b01c4b9e, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=00feacf3c0d364343957248be8b643ba, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f69c06b1b31a25e7c17175f781c3185b, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=729a58db7fb4592c77e2cc4df3adde86, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1831fcd6b7e2a5995e84df12185098d9, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cb70f48b8da268def615f833e60d23f4, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a12cce4691f2804e26ca94cccb4c0336, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c9c7af6c79927f83f8f93a4b2e508645, ASSIGN}] 2023-02-11 22:03:26,466 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1831fcd6b7e2a5995e84df12185098d9, ASSIGN 2023-02-11 22:03:26,466 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f69c06b1b31a25e7c17175f781c3185b, ASSIGN 2023-02-11 22:03:26,466 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=00feacf3c0d364343957248be8b643ba, ASSIGN 2023-02-11 22:03:26,467 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=729a58db7fb4592c77e2cc4df3adde86, ASSIGN 2023-02-11 22:03:26,467 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1831fcd6b7e2a5995e84df12185098d9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39829,1676153004496; forceNewPlan=false, retain=false 2023-02-11 22:03:26,467 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f69c06b1b31a25e7c17175f781c3185b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46823,1676153004617; forceNewPlan=false, retain=false 2023-02-11 22:03:26,468 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=00feacf3c0d364343957248be8b643ba, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39829,1676153004496; forceNewPlan=false, retain=false 2023-02-11 22:03:26,469 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=729a58db7fb4592c77e2cc4df3adde86, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46823,1676153004617; forceNewPlan=false, retain=false 2023-02-11 22:03:26,469 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c9c7af6c79927f83f8f93a4b2e508645, ASSIGN 2023-02-11 22:03:26,470 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a12cce4691f2804e26ca94cccb4c0336, ASSIGN 2023-02-11 22:03:26,470 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cb70f48b8da268def615f833e60d23f4, ASSIGN 2023-02-11 22:03:26,470 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=12b8f2259ac6e3ab0ee8ddf4b01c4b9e, ASSIGN 2023-02-11 22:03:26,470 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fe57fb58d8f76892415e2213259fe152, ASSIGN 2023-02-11 22:03:26,470 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c9c7af6c79927f83f8f93a4b2e508645, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46823,1676153004617; forceNewPlan=false, retain=false 2023-02-11 22:03:26,471 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a12cce4691f2804e26ca94cccb4c0336, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39829,1676153004496; forceNewPlan=false, retain=false 2023-02-11 22:03:26,471 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cb70f48b8da268def615f833e60d23f4, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46823,1676153004617; forceNewPlan=false, retain=false 2023-02-11 22:03:26,471 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fe57fb58d8f76892415e2213259fe152, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39829,1676153004496; forceNewPlan=false, retain=false 2023-02-11 22:03:26,471 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c8679eb44c4f2cd6567038643bfd5839, ASSIGN 2023-02-11 22:03:26,471 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=12b8f2259ac6e3ab0ee8ddf4b01c4b9e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39829,1676153004496; forceNewPlan=false, retain=false 2023-02-11 22:03:26,472 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c8679eb44c4f2cd6567038643bfd5839, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46823,1676153004617; forceNewPlan=false, retain=false 2023-02-11 22:03:26,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:26,618 INFO [jenkins-hbase9:38277] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-11 22:03:26,622 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=729a58db7fb4592c77e2cc4df3adde86, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:26,622 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=cb70f48b8da268def615f833e60d23f4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:26,622 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f69c06b1b31a25e7c17175f781c3185b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:26,622 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c8679eb44c4f2cd6567038643bfd5839, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:26,622 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153006622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153006622"}]},"ts":"1676153006622"} 2023-02-11 22:03:26,622 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676153006622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153006622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153006622"}]},"ts":"1676153006622"} 2023-02-11 22:03:26,622 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153006622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153006622"}]},"ts":"1676153006622"} 2023-02-11 22:03:26,622 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c9c7af6c79927f83f8f93a4b2e508645, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:26,622 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676153006622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153006622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153006622"}]},"ts":"1676153006622"} 2023-02-11 22:03:26,623 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153006622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153006622"}]},"ts":"1676153006622"} 2023-02-11 22:03:26,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure cb70f48b8da268def615f833e60d23f4, server=jenkins-hbase9.apache.org,46823,1676153004617}] 2023-02-11 22:03:26,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure c8679eb44c4f2cd6567038643bfd5839, server=jenkins-hbase9.apache.org,46823,1676153004617}] 2023-02-11 22:03:26,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=16, state=RUNNABLE; OpenRegionProcedure 729a58db7fb4592c77e2cc4df3adde86, server=jenkins-hbase9.apache.org,46823,1676153004617}] 2023-02-11 22:03:26,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=20, state=RUNNABLE; OpenRegionProcedure c9c7af6c79927f83f8f93a4b2e508645, server=jenkins-hbase9.apache.org,46823,1676153004617}] 2023-02-11 22:03:26,629 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=12b8f2259ac6e3ab0ee8ddf4b01c4b9e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:26,630 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153006629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153006629"}]},"ts":"1676153006629"} 2023-02-11 22:03:26,630 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure f69c06b1b31a25e7c17175f781c3185b, server=jenkins-hbase9.apache.org,46823,1676153004617}] 2023-02-11 22:03:26,630 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=fe57fb58d8f76892415e2213259fe152, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:26,631 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153006630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153006630"}]},"ts":"1676153006630"} 2023-02-11 22:03:26,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 12b8f2259ac6e3ab0ee8ddf4b01c4b9e, server=jenkins-hbase9.apache.org,39829,1676153004496}] 2023-02-11 22:03:26,635 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=1831fcd6b7e2a5995e84df12185098d9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:26,635 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006635"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153006635"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153006635"}]},"ts":"1676153006635"} 2023-02-11 22:03:26,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure fe57fb58d8f76892415e2213259fe152, server=jenkins-hbase9.apache.org,39829,1676153004496}] 2023-02-11 22:03:26,635 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=a12cce4691f2804e26ca94cccb4c0336, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:26,636 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006635"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153006635"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153006635"}]},"ts":"1676153006635"} 2023-02-11 22:03:26,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 1831fcd6b7e2a5995e84df12185098d9, server=jenkins-hbase9.apache.org,39829,1676153004496}] 2023-02-11 22:03:26,638 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=00feacf3c0d364343957248be8b643ba, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:26,638 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676153006285.00feacf3c0d364343957248be8b643ba.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153006638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153006638"}]},"ts":"1676153006638"} 2023-02-11 22:03:26,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=19, state=RUNNABLE; OpenRegionProcedure a12cce4691f2804e26ca94cccb4c0336, server=jenkins-hbase9.apache.org,39829,1676153004496}] 2023-02-11 22:03:26,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure 00feacf3c0d364343957248be8b643ba, server=jenkins-hbase9.apache.org,39829,1676153004496}] 2023-02-11 22:03:26,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:26,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c9c7af6c79927f83f8f93a4b2e508645, NAME => 'testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-11 22:03:26,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:26,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:26,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:26,785 INFO [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:26,786 DEBUG [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645/f1 2023-02-11 22:03:26,786 DEBUG [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645/f1 2023-02-11 22:03:26,787 INFO [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9c7af6c79927f83f8f93a4b2e508645 columnFamilyName f1 2023-02-11 22:03:26,787 INFO [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] regionserver.HStore(310): Store=c9c7af6c79927f83f8f93a4b2e508645/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,788 INFO [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:26,789 DEBUG [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645/f2 2023-02-11 22:03:26,789 DEBUG [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645/f2 2023-02-11 22:03:26,790 INFO [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9c7af6c79927f83f8f93a4b2e508645 columnFamilyName f2 2023-02-11 22:03:26,790 INFO [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] regionserver.HStore(310): Store=c9c7af6c79927f83f8f93a4b2e508645/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:26,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1831fcd6b7e2a5995e84df12185098d9, NAME => 'testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-11 22:03:26,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:26,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:26,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:26,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:26,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:26,793 INFO [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:26,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:26,794 DEBUG [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f1 2023-02-11 22:03:26,794 DEBUG [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f1 2023-02-11 22:03:26,795 INFO [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1831fcd6b7e2a5995e84df12185098d9 columnFamilyName f1 2023-02-11 22:03:26,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:26,795 INFO [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] regionserver.HStore(310): Store=1831fcd6b7e2a5995e84df12185098d9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,795 INFO [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:26,797 DEBUG [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f2 2023-02-11 22:03:26,797 DEBUG [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f2 2023-02-11 22:03:26,797 INFO [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1831fcd6b7e2a5995e84df12185098d9 columnFamilyName f2 2023-02-11 22:03:26,797 INFO [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] regionserver.HStore(310): Store=1831fcd6b7e2a5995e84df12185098d9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:26,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:26,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:26,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened c9c7af6c79927f83f8f93a4b2e508645; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63927231, jitterRate=-0.0474100261926651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:26,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for c9c7af6c79927f83f8f93a4b2e508645: Running coprocessor pre-open hook at 1676153006783Writing region info on filesystem at 1676153006783Initializing all the Stores at 1676153006784 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006784Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006785 (+1 ms)Cleaning up temporary data from old regions at 1676153006792 (+7 ms)Cleaning up detritus from prior splits at 1676153006793 (+1 ms)Running coprocessor post-open hooks at 1676153006804 (+11 ms)Region opened successfully at 1676153006804 2023-02-11 22:03:26,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645., pid=24, masterSystemTime=1676153006777 2023-02-11 22:03:26,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:26,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:26,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:26,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:26,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 729a58db7fb4592c77e2cc4df3adde86, NAME => 'testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-11 22:03:26,807 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c9c7af6c79927f83f8f93a4b2e508645, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:26,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:26,807 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676153006807"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153006807"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153006807"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153006807"}]},"ts":"1676153006807"} 2023-02-11 22:03:26,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:26,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:26,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:26,809 INFO [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:26,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:26,821 DEBUG [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f1 2023-02-11 22:03:26,821 DEBUG [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f1 2023-02-11 22:03:26,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1831fcd6b7e2a5995e84df12185098d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64690029, jitterRate=-0.036043450236320496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:26,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1831fcd6b7e2a5995e84df12185098d9: Running coprocessor pre-open hook at 1676153006791Writing region info on filesystem at 1676153006791Initializing all the Stores at 1676153006792 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006792Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006792Cleaning up temporary data from old regions at 1676153006805 (+13 ms)Cleaning up detritus from prior splits at 1676153006805Running coprocessor post-open hooks at 1676153006821 (+16 ms)Region opened successfully at 1676153006821 2023-02-11 22:03:26,821 INFO [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 729a58db7fb4592c77e2cc4df3adde86 columnFamilyName f1 2023-02-11 22:03:26,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9., pid=28, masterSystemTime=1676153006787 2023-02-11 22:03:26,822 INFO [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] regionserver.HStore(310): Store=729a58db7fb4592c77e2cc4df3adde86/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,822 INFO [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:26,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:26,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:26,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:26,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a12cce4691f2804e26ca94cccb4c0336, NAME => 'testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-11 22:03:26,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:26,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:26,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:26,837 DEBUG [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f2 2023-02-11 22:03:26,839 DEBUG [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f2 2023-02-11 22:03:26,839 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=1831fcd6b7e2a5995e84df12185098d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:26,839 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006837"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153006837"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153006837"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153006837"}]},"ts":"1676153006837"} 2023-02-11 22:03:26,839 INFO [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 729a58db7fb4592c77e2cc4df3adde86 columnFamilyName f2 2023-02-11 22:03:26,842 INFO [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] regionserver.HStore(310): Store=729a58db7fb4592c77e2cc4df3adde86/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,842 INFO [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:26,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=20 2023-02-11 22:03:26,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=20, state=SUCCESS; OpenRegionProcedure c9c7af6c79927f83f8f93a4b2e508645, server=jenkins-hbase9.apache.org,46823,1676153004617 in 212 msec 2023-02-11 22:03:26,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:26,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:26,845 DEBUG [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f1 2023-02-11 22:03:26,845 DEBUG [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f1 2023-02-11 22:03:26,845 INFO [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a12cce4691f2804e26ca94cccb4c0336 columnFamilyName f1 2023-02-11 22:03:26,846 INFO [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] regionserver.HStore(310): Store=a12cce4691f2804e26ca94cccb4c0336/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,846 INFO [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:26,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:26,848 DEBUG [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f2 2023-02-11 22:03:26,848 DEBUG [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f2 2023-02-11 22:03:26,848 INFO [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a12cce4691f2804e26ca94cccb4c0336 columnFamilyName f2 2023-02-11 22:03:26,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c9c7af6c79927f83f8f93a4b2e508645, ASSIGN in 381 msec 2023-02-11 22:03:26,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-11 22:03:26,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 1831fcd6b7e2a5995e84df12185098d9, server=jenkins-hbase9.apache.org,39829,1676153004496 in 206 msec 2023-02-11 22:03:26,849 INFO [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] regionserver.HStore(310): Store=a12cce4691f2804e26ca94cccb4c0336/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:26,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:26,850 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1831fcd6b7e2a5995e84df12185098d9, ASSIGN in 385 msec 2023-02-11 22:03:26,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:26,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:26,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:26,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:26,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:26,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened a12cce4691f2804e26ca94cccb4c0336; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74070202, jitterRate=0.10373201966285706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:26,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 729a58db7fb4592c77e2cc4df3adde86; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73243290, jitterRate=0.0914100706577301}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:26,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for a12cce4691f2804e26ca94cccb4c0336: Running coprocessor pre-open hook at 1676153006831Writing region info on filesystem at 1676153006831Initializing all the Stores at 1676153006834 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006836 (+2 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006839 (+3 ms)Cleaning up temporary data from old regions at 1676153006851 (+12 ms)Cleaning up detritus from prior splits at 1676153006852 (+1 ms)Running coprocessor post-open hooks at 1676153006860 (+8 ms)Region opened successfully at 1676153006860 2023-02-11 22:03:26,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 729a58db7fb4592c77e2cc4df3adde86: Running coprocessor pre-open hook at 1676153006808Writing region info on filesystem at 1676153006808Initializing all the Stores at 1676153006808Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006809 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006809Cleaning up temporary data from old regions at 1676153006846 (+37 ms)Cleaning up detritus from prior splits at 1676153006846Running coprocessor post-open hooks at 1676153006860 (+14 ms)Region opened successfully at 1676153006860 2023-02-11 22:03:26,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336., pid=29, masterSystemTime=1676153006787 2023-02-11 22:03:26,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86., pid=23, masterSystemTime=1676153006777 2023-02-11 22:03:26,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:26,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:26,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:26,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f69c06b1b31a25e7c17175f781c3185b, NAME => 'testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-11 22:03:26,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:26,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:26,863 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=729a58db7fb4592c77e2cc4df3adde86, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:26,864 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006863"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153006863"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153006863"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153006863"}]},"ts":"1676153006863"} 2023-02-11 22:03:26,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:26,864 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=a12cce4691f2804e26ca94cccb4c0336, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:26,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:26,864 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006864"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153006864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153006864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153006864"}]},"ts":"1676153006864"} 2023-02-11 22:03:26,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:26,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:26,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12b8f2259ac6e3ab0ee8ddf4b01c4b9e, NAME => 'testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-11 22:03:26,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:26,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:26,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:26,867 INFO [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:26,867 INFO [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:26,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=16 2023-02-11 22:03:26,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=19 2023-02-11 22:03:26,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=16, state=SUCCESS; OpenRegionProcedure 729a58db7fb4592c77e2cc4df3adde86, server=jenkins-hbase9.apache.org,46823,1676153004617 in 239 msec 2023-02-11 22:03:26,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=19, state=SUCCESS; OpenRegionProcedure a12cce4691f2804e26ca94cccb4c0336, server=jenkins-hbase9.apache.org,39829,1676153004496 in 227 msec 2023-02-11 22:03:26,869 DEBUG [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f1 2023-02-11 22:03:26,869 DEBUG [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f1 2023-02-11 22:03:26,870 INFO [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f69c06b1b31a25e7c17175f781c3185b columnFamilyName f1 2023-02-11 22:03:26,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a12cce4691f2804e26ca94cccb4c0336, ASSIGN in 405 msec 2023-02-11 22:03:26,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=729a58db7fb4592c77e2cc4df3adde86, ASSIGN in 405 msec 2023-02-11 22:03:26,870 DEBUG [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f1 2023-02-11 22:03:26,870 DEBUG [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f1 2023-02-11 22:03:26,870 INFO [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] regionserver.HStore(310): Store=f69c06b1b31a25e7c17175f781c3185b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,871 INFO [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:26,871 INFO [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12b8f2259ac6e3ab0ee8ddf4b01c4b9e columnFamilyName f1 2023-02-11 22:03:26,871 INFO [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] regionserver.HStore(310): Store=12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,872 INFO [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:26,872 DEBUG [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f2 2023-02-11 22:03:26,872 DEBUG [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f2 2023-02-11 22:03:26,872 INFO [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f69c06b1b31a25e7c17175f781c3185b columnFamilyName f2 2023-02-11 22:03:26,873 DEBUG [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f2 2023-02-11 22:03:26,873 DEBUG [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f2 2023-02-11 22:03:26,873 INFO [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12b8f2259ac6e3ab0ee8ddf4b01c4b9e columnFamilyName f2 2023-02-11 22:03:26,874 INFO [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] regionserver.HStore(310): Store=f69c06b1b31a25e7c17175f781c3185b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,874 INFO [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] regionserver.HStore(310): Store=12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:26,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:26,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:26,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:26,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:26,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:26,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:26,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:26,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:26,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:26,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened f69c06b1b31a25e7c17175f781c3185b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69989003, jitterRate=0.042917415499687195}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:26,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 12b8f2259ac6e3ab0ee8ddf4b01c4b9e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60851327, jitterRate=-0.09324456751346588}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:26,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for f69c06b1b31a25e7c17175f781c3185b: Running coprocessor pre-open hook at 1676153006864Writing region info on filesystem at 1676153006864Initializing all the Stores at 1676153006865 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006865Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006867 (+2 ms)Cleaning up temporary data from old regions at 1676153006876 (+9 ms)Cleaning up detritus from prior splits at 1676153006876Running coprocessor post-open hooks at 1676153006888 (+12 ms)Region opened successfully at 1676153006888 2023-02-11 22:03:26,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e: Running coprocessor pre-open hook at 1676153006865Writing region info on filesystem at 1676153006865Initializing all the Stores at 1676153006866 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006866Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006867 (+1 ms)Cleaning up temporary data from old regions at 1676153006876 (+9 ms)Cleaning up detritus from prior splits at 1676153006876Running coprocessor post-open hooks at 1676153006888 (+12 ms)Region opened successfully at 1676153006888 2023-02-11 22:03:26,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b., pid=25, masterSystemTime=1676153006777 2023-02-11 22:03:26,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e., pid=26, masterSystemTime=1676153006787 2023-02-11 22:03:26,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:26,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:26,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:26,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cb70f48b8da268def615f833e60d23f4, NAME => 'testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-11 22:03:26,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:26,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:26,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:26,891 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f69c06b1b31a25e7c17175f781c3185b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:26,892 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006891"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153006891"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153006891"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153006891"}]},"ts":"1676153006891"} 2023-02-11 22:03:26,892 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=12b8f2259ac6e3ab0ee8ddf4b01c4b9e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:26,892 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006892"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153006892"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153006892"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153006892"}]},"ts":"1676153006892"} 2023-02-11 22:03:26,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:26,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:26,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:26,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 00feacf3c0d364343957248be8b643ba, NAME => 'testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-11 22:03:26,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:26,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:26,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:26,895 INFO [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:26,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-11 22:03:26,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure f69c06b1b31a25e7c17175f781c3185b, server=jenkins-hbase9.apache.org,46823,1676153004617 in 263 msec 2023-02-11 22:03:26,897 DEBUG [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f1 2023-02-11 22:03:26,897 DEBUG [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f1 2023-02-11 22:03:26,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-11 22:03:26,897 INFO [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb70f48b8da268def615f833e60d23f4 columnFamilyName f1 2023-02-11 22:03:26,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 12b8f2259ac6e3ab0ee8ddf4b01c4b9e, server=jenkins-hbase9.apache.org,39829,1676153004496 in 262 msec 2023-02-11 22:03:26,897 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f69c06b1b31a25e7c17175f781c3185b, ASSIGN in 432 msec 2023-02-11 22:03:26,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=12b8f2259ac6e3ab0ee8ddf4b01c4b9e, ASSIGN in 434 msec 2023-02-11 22:03:26,903 INFO [StoreOpener-00feacf3c0d364343957248be8b643ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:26,903 INFO [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] regionserver.HStore(310): Store=cb70f48b8da268def615f833e60d23f4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,903 INFO [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:26,904 DEBUG [StoreOpener-00feacf3c0d364343957248be8b643ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f1 2023-02-11 22:03:26,904 DEBUG [StoreOpener-00feacf3c0d364343957248be8b643ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f1 2023-02-11 22:03:26,905 INFO [StoreOpener-00feacf3c0d364343957248be8b643ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00feacf3c0d364343957248be8b643ba columnFamilyName f1 2023-02-11 22:03:26,905 INFO [StoreOpener-00feacf3c0d364343957248be8b643ba-1] regionserver.HStore(310): Store=00feacf3c0d364343957248be8b643ba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,905 INFO [StoreOpener-00feacf3c0d364343957248be8b643ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:26,907 DEBUG [StoreOpener-00feacf3c0d364343957248be8b643ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f2 2023-02-11 22:03:26,907 DEBUG [StoreOpener-00feacf3c0d364343957248be8b643ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f2 2023-02-11 22:03:26,907 INFO [StoreOpener-00feacf3c0d364343957248be8b643ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00feacf3c0d364343957248be8b643ba columnFamilyName f2 2023-02-11 22:03:26,908 INFO [StoreOpener-00feacf3c0d364343957248be8b643ba-1] regionserver.HStore(310): Store=00feacf3c0d364343957248be8b643ba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:26,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:26,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:26,910 DEBUG [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f2 2023-02-11 22:03:26,910 DEBUG [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f2 2023-02-11 22:03:26,910 INFO [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb70f48b8da268def615f833e60d23f4 columnFamilyName f2 2023-02-11 22:03:26,911 INFO [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] regionserver.HStore(310): Store=cb70f48b8da268def615f833e60d23f4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:26,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:26,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:26,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:26,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:26,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:26,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:26,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:26,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 00feacf3c0d364343957248be8b643ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67758869, jitterRate=0.009685829281806946}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:26,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 00feacf3c0d364343957248be8b643ba: Running coprocessor pre-open hook at 1676153006894Writing region info on filesystem at 1676153006894Initializing all the Stores at 1676153006895 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006895Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006903 (+8 ms)Cleaning up temporary data from old regions at 1676153006910 (+7 ms)Cleaning up detritus from prior splits at 1676153006910Running coprocessor post-open hooks at 1676153006920 (+10 ms)Region opened successfully at 1676153006920 2023-02-11 22:03:26,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened cb70f48b8da268def615f833e60d23f4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63556690, jitterRate=-0.052931517362594604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:26,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for cb70f48b8da268def615f833e60d23f4: Running coprocessor pre-open hook at 1676153006891Writing region info on filesystem at 1676153006891Initializing all the Stores at 1676153006892 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006892Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006893 (+1 ms)Cleaning up temporary data from old regions at 1676153006912 (+19 ms)Cleaning up detritus from prior splits at 1676153006913 (+1 ms)Running coprocessor post-open hooks at 1676153006920 (+7 ms)Region opened successfully at 1676153006920 2023-02-11 22:03:26,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4., pid=21, masterSystemTime=1676153006777 2023-02-11 22:03:26,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba., pid=30, masterSystemTime=1676153006787 2023-02-11 22:03:26,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:26,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:26,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:26,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c8679eb44c4f2cd6567038643bfd5839, NAME => 'testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-11 22:03:26,923 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=cb70f48b8da268def615f833e60d23f4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:26,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:26,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:26,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,923 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006923"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153006923"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153006923"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153006923"}]},"ts":"1676153006923"} 2023-02-11 22:03:26,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:26,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:26,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:26,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:26,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fe57fb58d8f76892415e2213259fe152, NAME => 'testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-11 22:03:26,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:26,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:26,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:26,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:26,924 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=00feacf3c0d364343957248be8b643ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:26,925 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676153006285.00feacf3c0d364343957248be8b643ba.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006924"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153006924"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153006924"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153006924"}]},"ts":"1676153006924"} 2023-02-11 22:03:26,925 INFO [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:26,926 INFO [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:26,927 DEBUG [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839/f1 2023-02-11 22:03:26,927 DEBUG [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f1 2023-02-11 22:03:26,927 DEBUG [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f1 2023-02-11 22:03:26,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-11 22:03:26,927 DEBUG [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839/f1 2023-02-11 22:03:26,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure cb70f48b8da268def615f833e60d23f4, server=jenkins-hbase9.apache.org,46823,1676153004617 in 301 msec 2023-02-11 22:03:26,928 INFO [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe57fb58d8f76892415e2213259fe152 columnFamilyName f1 2023-02-11 22:03:26,928 INFO [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8679eb44c4f2cd6567038643bfd5839 columnFamilyName f1 2023-02-11 22:03:26,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-11 22:03:26,929 INFO [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] regionserver.HStore(310): Store=fe57fb58d8f76892415e2213259fe152/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure 00feacf3c0d364343957248be8b643ba, server=jenkins-hbase9.apache.org,39829,1676153004496 in 287 msec 2023-02-11 22:03:26,929 INFO [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] regionserver.HStore(310): Store=c8679eb44c4f2cd6567038643bfd5839/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,929 INFO [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:26,929 INFO [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:26,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cb70f48b8da268def615f833e60d23f4, ASSIGN in 464 msec 2023-02-11 22:03:26,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=00feacf3c0d364343957248be8b643ba, ASSIGN in 466 msec 2023-02-11 22:03:26,930 DEBUG [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f2 2023-02-11 22:03:26,930 DEBUG [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839/f2 2023-02-11 22:03:26,930 DEBUG [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f2 2023-02-11 22:03:26,930 DEBUG [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839/f2 2023-02-11 22:03:26,931 INFO [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe57fb58d8f76892415e2213259fe152 columnFamilyName f2 2023-02-11 22:03:26,931 INFO [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8679eb44c4f2cd6567038643bfd5839 columnFamilyName f2 2023-02-11 22:03:26,931 INFO [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] regionserver.HStore(310): Store=fe57fb58d8f76892415e2213259fe152/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,931 INFO [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] regionserver.HStore(310): Store=c8679eb44c4f2cd6567038643bfd5839/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:26,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:26,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:26,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:26,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:26,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:26,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:26,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:26,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:26,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:26,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:26,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened fe57fb58d8f76892415e2213259fe152; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70321594, jitterRate=0.04787340760231018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:26,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened c8679eb44c4f2cd6567038643bfd5839; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63199821, jitterRate=-0.058249279856681824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:26,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for fe57fb58d8f76892415e2213259fe152: Running coprocessor pre-open hook at 1676153006924Writing region info on filesystem at 1676153006924Initializing all the Stores at 1676153006925 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006925Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006925Cleaning up temporary data from old regions at 1676153006934 (+9 ms)Cleaning up detritus from prior splits at 1676153006934Running coprocessor post-open hooks at 1676153006939 (+5 ms)Region opened successfully at 1676153006939 2023-02-11 22:03:26,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for c8679eb44c4f2cd6567038643bfd5839: Running coprocessor pre-open hook at 1676153006923Writing region info on filesystem at 1676153006923Initializing all the Stores at 1676153006924 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006924Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153006925 (+1 ms)Cleaning up temporary data from old regions at 1676153006933 (+8 ms)Cleaning up detritus from prior splits at 1676153006934 (+1 ms)Running coprocessor post-open hooks at 1676153006939 (+5 ms)Region opened successfully at 1676153006939 2023-02-11 22:03:26,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152., pid=27, masterSystemTime=1676153006787 2023-02-11 22:03:26,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839., pid=22, masterSystemTime=1676153006777 2023-02-11 22:03:26,941 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=fe57fb58d8f76892415e2213259fe152, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:26,942 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676153006941"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153006941"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153006941"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153006941"}]},"ts":"1676153006941"} 2023-02-11 22:03:26,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:26,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:26,942 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c8679eb44c4f2cd6567038643bfd5839, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:26,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:26,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:26,942 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676153006942"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153006942"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153006942"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153006942"}]},"ts":"1676153006942"} 2023-02-11 22:03:26,945 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-11 22:03:26,945 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure fe57fb58d8f76892415e2213259fe152, server=jenkins-hbase9.apache.org,39829,1676153004496 in 308 msec 2023-02-11 22:03:26,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-11 22:03:26,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure c8679eb44c4f2cd6567038643bfd5839, server=jenkins-hbase9.apache.org,46823,1676153004617 in 319 msec 2023-02-11 22:03:26,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fe57fb58d8f76892415e2213259fe152, ASSIGN in 482 msec 2023-02-11 22:03:26,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 22:03:26,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c8679eb44c4f2cd6567038643bfd5839, ASSIGN in 483 msec 2023-02-11 22:03:26,948 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:26,948 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153006948"}]},"ts":"1676153006948"} 2023-02-11 22:03:26,949 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-11 22:03:26,954 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:26,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 669 msec 2023-02-11 22:03:27,343 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 22:03:27,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:27,413 INFO [Listener at localhost/34985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-11 22:03:27,413 DEBUG [Listener at localhost/34985] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-11 22:03:27,413 INFO [Listener at localhost/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:27,419 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-11 22:03:27,419 INFO [Listener at localhost/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:27,419 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-11 22:03:27,419 INFO [Listener at localhost/34985] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 22:03:27,510 DEBUG [hconnection-0x789ebc49-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:27,529 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40810, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:27,537 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:27,549 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39829] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:27,680 INFO [Listener at localhost/34985] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 22:03:27,681 INFO [Listener at localhost/34985] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 22:03:27,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 22:03:27,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676153007682 (current time:1676153007682). 2023-02-11 22:03:27,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 22:03:27,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] zookeeper.ReadOnlyZKClient(139): Connect 0x35d6fe75 to 127.0.0.1:53876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:27,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9d547e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:27,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:27,693 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58868, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:27,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35d6fe75 to 127.0.0.1:53876 2023-02-11 22:03:27,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:27,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 22:03:27,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 22:03:27,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 22:03:27,700 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 22:03:27,701 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676153607701 2023-02-11 22:03:27,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 22:03:27,702 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-11 22:03:27,707 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 22:03:27,707 DEBUG [Listener at localhost/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:27,707 DEBUG [Listener at localhost/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 22:03:27,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 22:03:27,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 10 msec 2023-02-11 22:03:27,709 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 22:03:27,710 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676153607710 2023-02-11 22:03:27,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,731 INFO [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-11 22:03:27,731 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:27,732 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-11 22:03:27,732 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-11 22:03:27,798 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,798 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,799 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:27,799 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:27,799 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:27,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:27,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:27,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:27,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:27,800 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:27,800 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:27,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,800 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:27,800 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:27,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-11 22:03:27,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-11 22:03:27,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,801 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-11 22:03:27,801 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-11 22:03:27,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,802 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-11 22:03:27,802 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:27,802 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-11 22:03:27,802 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-11 22:03:27,802 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46823,1676153004617' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-11 22:03:27,802 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-11 22:03:27,803 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:27,810 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-11 22:03:27,810 DEBUG [Listener at localhost/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:27,810 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-11 22:03:27,810 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39829,1676153004496' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-11 22:03:27,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 22:03:27,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:27,812 DEBUG [Listener at localhost/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 22:03:27,813 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:27,813 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:27,814 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,814 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:27,814 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:27,814 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:27,815 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,815 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:27,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:27,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:27,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:27,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:27,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46823,1676153004617' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-11 22:03:27,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2386d04b[Count = 1] remaining members to acquire global barrier 2023-02-11 22:03:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:27,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39829,1676153004496' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-11 22:03:27,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2386d04b[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:27,819 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-11 22:03:27,819 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,821 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,821 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,821 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-11 22:03:27,821 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-11 22:03:27,821 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:27,822 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:27,822 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:27,823 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:27,823 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. started... 2023-02-11 22:03:27,824 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 729a58db7fb4592c77e2cc4df3adde86 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:27,827 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:27,827 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. started... 2023-02-11 22:03:27,833 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 22:03:27,833 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:27,833 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 22:03:27,833 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:27,833 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. started... 2023-02-11 22:03:27,833 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. started... 2023-02-11 22:03:27,839 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] regionserver.HRegion(2744): Flushing cb70f48b8da268def615f833e60d23f4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:27,839 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:27,839 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 22:03:27,839 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 22:03:27,835 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:27,839 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. started... 2023-02-11 22:03:27,839 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. started... 2023-02-11 22:03:27,843 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] regionserver.HRegion(2744): Flushing a12cce4691f2804e26ca94cccb4c0336 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 22:03:27,843 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 00feacf3c0d364343957248be8b643ba 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:27,843 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] regionserver.HRegion(2744): Flushing f69c06b1b31a25e7c17175f781c3185b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:27,843 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 1831fcd6b7e2a5995e84df12185098d9 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:27,866 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/.tmp/f1/5081356e20e9480aa7186dc2c2e2ce72 2023-02-11 22:03:27,916 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/.tmp/f1/4bb0ec119ce04da290581c573e812ee0 2023-02-11 22:03:27,923 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/.tmp/f1/e5bb40ccfe4b499996c354a86a053ef2 2023-02-11 22:03:27,933 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/.tmp/f1/38d77e39a30543b1bf43a6aa847a29d2 2023-02-11 22:03:27,952 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/.tmp/f2/4999ef838618481fb001cfe4e1640833 2023-02-11 22:03:27,960 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/.tmp/f1/5081356e20e9480aa7186dc2c2e2ce72 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f1/5081356e20e9480aa7186dc2c2e2ce72 2023-02-11 22:03:27,963 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/.tmp/f1/0f0ed13e180049b5935d16916fe862ec 2023-02-11 22:03:27,971 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f1/5081356e20e9480aa7186dc2c2e2ce72, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:27,972 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/.tmp/f2/4999ef838618481fb001cfe4e1640833 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f2/4999ef838618481fb001cfe4e1640833 2023-02-11 22:03:27,978 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f2/4999ef838618481fb001cfe4e1640833, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:27,980 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 729a58db7fb4592c77e2cc4df3adde86 in 155ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:27,980 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-11 22:03:27,980 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 729a58db7fb4592c77e2cc4df3adde86: 2023-02-11 22:03:27,980 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,981 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:27,981 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f1/5081356e20e9480aa7186dc2c2e2ce72] hfiles 2023-02-11 22:03:27,981 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f1/5081356e20e9480aa7186dc2c2e2ce72 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:27,981 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f2/4999ef838618481fb001cfe4e1640833] hfiles 2023-02-11 22:03:27,981 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f2/4999ef838618481fb001cfe4e1640833 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,013 DEBUG [Listener at localhost/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:28,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 22:03:28,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:28,015 DEBUG [Listener at localhost/34985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 22:03:28,027 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/.tmp/f2/404a88af696d44699c592e647e1af4f9 2023-02-11 22:03:28,028 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/.tmp/f2/14743fd05ae549548b6a58b083bde645 2023-02-11 22:03:28,035 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. completed. 2023-02-11 22:03:28,035 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:28,035 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:28,035 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 22:03:28,035 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. started... 2023-02-11 22:03:28,038 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/.tmp/f1/0f0ed13e180049b5935d16916fe862ec as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f1/0f0ed13e180049b5935d16916fe862ec 2023-02-11 22:03:28,043 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f1/0f0ed13e180049b5935d16916fe862ec, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:28,044 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/.tmp/f2/404a88af696d44699c592e647e1af4f9 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f2/404a88af696d44699c592e647e1af4f9 2023-02-11 22:03:28,050 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f2/404a88af696d44699c592e647e1af4f9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:28,051 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f69c06b1b31a25e7c17175f781c3185b in 208ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:28,061 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f69c06b1b31a25e7c17175f781c3185b: 2023-02-11 22:03:28,061 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for c9c7af6c79927f83f8f93a4b2e508645: 2023-02-11 22:03:28,061 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,061 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,061 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:28,061 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:28,061 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f1/0f0ed13e180049b5935d16916fe862ec] hfiles 2023-02-11 22:03:28,061 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 22:03:28,061 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f1/0f0ed13e180049b5935d16916fe862ec for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,061 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 22:03:28,062 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f2/404a88af696d44699c592e647e1af4f9] hfiles 2023-02-11 22:03:28,062 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f2/404a88af696d44699c592e647e1af4f9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,067 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/.tmp/f1/e5bb40ccfe4b499996c354a86a053ef2 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f1/e5bb40ccfe4b499996c354a86a053ef2 2023-02-11 22:03:28,067 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/.tmp/f2/09511af515854e7985d5dc670d393aef 2023-02-11 22:03:28,075 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f1/e5bb40ccfe4b499996c354a86a053ef2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:28,078 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/.tmp/f2/14743fd05ae549548b6a58b083bde645 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f2/14743fd05ae549548b6a58b083bde645 2023-02-11 22:03:28,082 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/.tmp/f1/38d77e39a30543b1bf43a6aa847a29d2 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f1/38d77e39a30543b1bf43a6aa847a29d2 2023-02-11 22:03:28,084 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f2/14743fd05ae549548b6a58b083bde645, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:28,085 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cb70f48b8da268def615f833e60d23f4 in 251ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:28,085 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for cb70f48b8da268def615f833e60d23f4: 2023-02-11 22:03:28,086 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,086 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:28,086 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f1/e5bb40ccfe4b499996c354a86a053ef2] hfiles 2023-02-11 22:03:28,086 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f1/e5bb40ccfe4b499996c354a86a053ef2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,086 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f2/14743fd05ae549548b6a58b083bde645] hfiles 2023-02-11 22:03:28,086 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f2/14743fd05ae549548b6a58b083bde645 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,093 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f1/38d77e39a30543b1bf43a6aa847a29d2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:28,094 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. completed. 2023-02-11 22:03:28,094 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:28,094 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. completed. 2023-02-11 22:03:28,094 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:28,094 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 22:03:28,094 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 22:03:28,094 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:28,094 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. started... 2023-02-11 22:03:28,095 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c8679eb44c4f2cd6567038643bfd5839: 2023-02-11 22:03:28,095 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,095 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:28,095 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 22:03:28,095 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 22:03:28,095 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/.tmp/f2/09511af515854e7985d5dc670d393aef as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f2/09511af515854e7985d5dc670d393aef 2023-02-11 22:03:28,101 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. completed. 2023-02-11 22:03:28,101 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:28,101 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 22:03:28,107 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f2/09511af515854e7985d5dc670d393aef, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:28,109 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 00feacf3c0d364343957248be8b643ba in 266ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:28,109 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 00feacf3c0d364343957248be8b643ba: 2023-02-11 22:03:28,109 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,109 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:28,109 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f1/38d77e39a30543b1bf43a6aa847a29d2] hfiles 2023-02-11 22:03:28,109 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f1/38d77e39a30543b1bf43a6aa847a29d2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,109 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f2/09511af515854e7985d5dc670d393aef] hfiles 2023-02-11 22:03:28,109 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f2/09511af515854e7985d5dc670d393aef for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,111 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. completed. 2023-02-11 22:03:28,111 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:28,111 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 22:03:28,111 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 22:03:28,111 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,111 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-11 22:03:28,111 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase9.apache.org,46823,1676153004617' in zk 2023-02-11 22:03:28,113 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-11 22:03:28,113 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,113 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:28,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:28,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:28,113 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-11 22:03:28,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:28,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:28,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:28,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:28,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase9.apache.org,46823,1676153004617': 2023-02-11 22:03:28,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46823,1676153004617' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-11 22:03:28,122 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. completed. 2023-02-11 22:03:28,122 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:28,122 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:28,122 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 22:03:28,122 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. started... 2023-02-11 22:03:28,123 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegion(2744): Flushing fe57fb58d8f76892415e2213259fe152 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 22:03:28,136 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/.tmp/f1/6971d2d1a61c4b6e8ef01b511a0497da 2023-02-11 22:03:28,151 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/.tmp/f2/49cf8477658a4479bffaa8a51a51bcf4 2023-02-11 22:03:28,156 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/.tmp/f1/6971d2d1a61c4b6e8ef01b511a0497da as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f1/6971d2d1a61c4b6e8ef01b511a0497da 2023-02-11 22:03:28,161 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f1/6971d2d1a61c4b6e8ef01b511a0497da, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 22:03:28,162 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/.tmp/f2/49cf8477658a4479bffaa8a51a51bcf4 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f2/49cf8477658a4479bffaa8a51a51bcf4 2023-02-11 22:03:28,168 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f2/49cf8477658a4479bffaa8a51a51bcf4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 22:03:28,168 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for fe57fb58d8f76892415e2213259fe152 in 45ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:28,169 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for fe57fb58d8f76892415e2213259fe152: 2023-02-11 22:03:28,169 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,169 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:28,169 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f1/6971d2d1a61c4b6e8ef01b511a0497da] hfiles 2023-02-11 22:03:28,169 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f1/6971d2d1a61c4b6e8ef01b511a0497da for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,169 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f2/49cf8477658a4479bffaa8a51a51bcf4] hfiles 2023-02-11 22:03:28,169 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f2/49cf8477658a4479bffaa8a51a51bcf4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,179 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. completed. 2023-02-11 22:03:28,179 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:28,179 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 22:03:28,179 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:28,179 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. started... 2023-02-11 22:03:28,180 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:28,199 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/.tmp/f1/42a4f9f7380943f9879f8de426f2c5f7 2023-02-11 22:03:28,219 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/.tmp/f2/3e1e9ed61f2844d590fc8dabb57474e4 2023-02-11 22:03:28,226 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/.tmp/f1/42a4f9f7380943f9879f8de426f2c5f7 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f1/42a4f9f7380943f9879f8de426f2c5f7 2023-02-11 22:03:28,232 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f1/42a4f9f7380943f9879f8de426f2c5f7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:28,233 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/.tmp/f2/3e1e9ed61f2844d590fc8dabb57474e4 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f2/3e1e9ed61f2844d590fc8dabb57474e4 2023-02-11 22:03:28,239 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f2/3e1e9ed61f2844d590fc8dabb57474e4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:28,240 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e in 60ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:28,240 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e: 2023-02-11 22:03:28,240 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,241 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:28,241 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f1/42a4f9f7380943f9879f8de426f2c5f7] hfiles 2023-02-11 22:03:28,241 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f1/42a4f9f7380943f9879f8de426f2c5f7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,241 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f2/3e1e9ed61f2844d590fc8dabb57474e4] hfiles 2023-02-11 22:03:28,241 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f2/3e1e9ed61f2844d590fc8dabb57474e4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,250 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. completed. 2023-02-11 22:03:28,250 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:28,250 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 22:03:28,315 DEBUG [Listener at localhost/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:28,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 22:03:28,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:28,317 DEBUG [Listener at localhost/34985] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 22:03:28,344 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/.tmp/f1/fb4ae4cf641d4185888bb0064520d6c7 2023-02-11 22:03:28,360 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/.tmp/f2/8affe3ae766643b59fd7ccf2032b32a0 2023-02-11 22:03:28,366 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/.tmp/f1/fb4ae4cf641d4185888bb0064520d6c7 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f1/fb4ae4cf641d4185888bb0064520d6c7 2023-02-11 22:03:28,370 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f1/fb4ae4cf641d4185888bb0064520d6c7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:28,371 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/.tmp/f2/8affe3ae766643b59fd7ccf2032b32a0 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f2/8affe3ae766643b59fd7ccf2032b32a0 2023-02-11 22:03:28,375 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f2/8affe3ae766643b59fd7ccf2032b32a0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:28,376 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1831fcd6b7e2a5995e84df12185098d9 in 533ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:28,376 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1831fcd6b7e2a5995e84df12185098d9: 2023-02-11 22:03:28,376 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,376 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:28,377 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f1/fb4ae4cf641d4185888bb0064520d6c7] hfiles 2023-02-11 22:03:28,377 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f1/fb4ae4cf641d4185888bb0064520d6c7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,377 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f2/8affe3ae766643b59fd7ccf2032b32a0] hfiles 2023-02-11 22:03:28,377 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f2/8affe3ae766643b59fd7ccf2032b32a0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,389 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. completed. 2023-02-11 22:03:28,390 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:28,390 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 22:03:28,422 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/.tmp/f2/39c9f5e475ed4a24a555c429d5454e52 2023-02-11 22:03:28,428 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/.tmp/f1/4bb0ec119ce04da290581c573e812ee0 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f1/4bb0ec119ce04da290581c573e812ee0 2023-02-11 22:03:28,433 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f1/4bb0ec119ce04da290581c573e812ee0, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 22:03:28,434 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/.tmp/f2/39c9f5e475ed4a24a555c429d5454e52 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f2/39c9f5e475ed4a24a555c429d5454e52 2023-02-11 22:03:28,439 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f2/39c9f5e475ed4a24a555c429d5454e52, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 22:03:28,440 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for a12cce4691f2804e26ca94cccb4c0336 in 597ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:28,440 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a12cce4691f2804e26ca94cccb4c0336: 2023-02-11 22:03:28,441 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,441 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:28,441 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f1/4bb0ec119ce04da290581c573e812ee0] hfiles 2023-02-11 22:03:28,441 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f1/4bb0ec119ce04da290581c573e812ee0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,441 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f2/39c9f5e475ed4a24a555c429d5454e52] hfiles 2023-02-11 22:03:28,441 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f2/39c9f5e475ed4a24a555c429d5454e52 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,447 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. completed. 2023-02-11 22:03:28,447 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:28,447 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 22:03:28,447 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 22:03:28,447 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:28,447 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-11 22:03:28,448 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase9.apache.org,39829,1676153004496' in zk 2023-02-11 22:03:28,449 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:28,449 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-11 22:03:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:28,449 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:28,449 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-11 22:03:28,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:28,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:28,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:28,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:28,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:28,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:28,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase9.apache.org,39829,1676153004496': 2023-02-11 22:03:28,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39829,1676153004496' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-11 22:03:28,454 INFO [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-11 22:03:28,454 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:28,454 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:28,454 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,454 INFO [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 22:03:28,456 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,456 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:28,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:28,456 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:28,456 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,457 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:28,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:28,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:28,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:28,459 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,460 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:28,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:28,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:28,461 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:28,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,462 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:28,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,468 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,468 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,468 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:28,468 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:28,468 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:28,468 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:28,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:28,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:28,468 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:28,468 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:28,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:28,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,468 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:28,469 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:28,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,469 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:28,470 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:28,470 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,470 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:28,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,739 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-11 22:03:28,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,740 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:28,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676153007702Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676153008469 (+767 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676153008470 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676153008488 (+18 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676153008499 (+11 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676153008739 (+240 ms) 2023-02-11 22:03:28,741 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 22:03:28,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0380 sec 2023-02-11 22:03:28,817 DEBUG [Listener at localhost/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:28,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 22:03:28,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 22:03:28,819 INFO [Listener at localhost/34985] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 22:03:28,824 INFO [Listener at localhost/34985] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 22:03:28,831 INFO [Listener at localhost/34985] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 22:03:28,861 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:28,873 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39829] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:29,015 INFO [Listener at localhost/34985] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 22:03:29,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-11 22:03:29,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-11 22:03:29,030 INFO [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-11 22:03:29,030 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:29,031 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-11 22:03:29,031 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-11 22:03:29,031 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,031 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:29,033 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:29,033 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:29,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:29,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:29,033 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:29,034 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,034 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:29,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:29,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:29,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:29,034 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 22:03:29,034 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 22:03:29,034 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,034 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:29,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 22:03:29,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 22:03:29,039 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 22:03:29,039 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:29,039 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 22:03:29,040 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 22:03:29,040 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:29,040 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 22:03:29,040 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:29,040 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. started... 2023-02-11 22:03:29,041 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a12cce4691f2804e26ca94cccb4c0336 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 22:03:29,041 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:29,041 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 22:03:29,041 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 22:03:29,041 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:29,041 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. started... 2023-02-11 22:03:29,041 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. started... 2023-02-11 22:03:29,041 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 00feacf3c0d364343957248be8b643ba 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:29,041 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1831fcd6b7e2a5995e84df12185098d9 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:29,042 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:29,042 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. started... 2023-02-11 22:03:29,043 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 729a58db7fb4592c77e2cc4df3adde86 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:29,043 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 22:03:29,043 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 22:03:29,043 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:29,053 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. started... 2023-02-11 22:03:29,053 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f69c06b1b31a25e7c17175f781c3185b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:29,043 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:29,053 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. started... 2023-02-11 22:03:29,053 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cb70f48b8da268def615f833e60d23f4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:29,087 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/.tmp/f1/133c8b4b1248416fa6d2f5badaab26ea 2023-02-11 22:03:29,095 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/.tmp/f1/e07745bb0e5d43d7bda01d5a9730a3d0 2023-02-11 22:03:29,114 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/.tmp/f1/fc1fb2cfd82b47beb4fc4035752689ae 2023-02-11 22:03:29,123 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/.tmp/f1/70625b60fa6c44bf9f7b815b46658a9d 2023-02-11 22:03:29,135 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/.tmp/f1/fd87af44aed44a66a52ad47340c21862 2023-02-11 22:03:29,135 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/.tmp/f1/eaf8e601f28d46f392903bb9eb969b40 2023-02-11 22:03:29,149 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/.tmp/f2/8b6dfc1ae7104286897e1ee8f27c36ea 2023-02-11 22:03:29,161 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/.tmp/f1/e07745bb0e5d43d7bda01d5a9730a3d0 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f1/e07745bb0e5d43d7bda01d5a9730a3d0 2023-02-11 22:03:29,163 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/.tmp/f2/a4b0fb58803346b3a6d37cb3862b0ec5 2023-02-11 22:03:29,167 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f1/e07745bb0e5d43d7bda01d5a9730a3d0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 22:03:29,168 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/.tmp/f2/8b6dfc1ae7104286897e1ee8f27c36ea as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f2/8b6dfc1ae7104286897e1ee8f27c36ea 2023-02-11 22:03:29,172 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/.tmp/f1/133c8b4b1248416fa6d2f5badaab26ea as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f1/133c8b4b1248416fa6d2f5badaab26ea 2023-02-11 22:03:29,174 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f2/8b6dfc1ae7104286897e1ee8f27c36ea, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 22:03:29,175 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for a12cce4691f2804e26ca94cccb4c0336 in 134ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:29,175 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a12cce4691f2804e26ca94cccb4c0336: 2023-02-11 22:03:29,175 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:29,178 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f1/133c8b4b1248416fa6d2f5badaab26ea, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:29,179 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/.tmp/f2/a4b0fb58803346b3a6d37cb3862b0ec5 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f2/a4b0fb58803346b3a6d37cb3862b0ec5 2023-02-11 22:03:29,183 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:29,183 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 22:03:29,183 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. started... 2023-02-11 22:03:29,183 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe57fb58d8f76892415e2213259fe152 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 22:03:29,187 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/.tmp/f2/1f7c21213a1b499fbffa2356255dbd5c 2023-02-11 22:03:29,195 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f2/a4b0fb58803346b3a6d37cb3862b0ec5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:29,199 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f69c06b1b31a25e7c17175f781c3185b in 146ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:29,199 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/.tmp/f2/86c831e23a9e428f970c86b92652cb30 2023-02-11 22:03:29,199 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f69c06b1b31a25e7c17175f781c3185b: 2023-02-11 22:03:29,199 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:29,199 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:29,199 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/.tmp/f2/d5fa3a6ee0c1489b9b76252d2829d5f4 2023-02-11 22:03:29,199 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 22:03:29,199 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. started... 2023-02-11 22:03:29,200 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c9c7af6c79927f83f8f93a4b2e508645: 2023-02-11 22:03:29,200 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:29,200 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:29,200 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. started... 2023-02-11 22:03:29,200 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c8679eb44c4f2cd6567038643bfd5839: 2023-02-11 22:03:29,200 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:29,200 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 22:03:29,200 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 22:03:29,201 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/.tmp/f1/70625b60fa6c44bf9f7b815b46658a9d as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f1/70625b60fa6c44bf9f7b815b46658a9d 2023-02-11 22:03:29,206 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/.tmp/f1/fc1fb2cfd82b47beb4fc4035752689ae as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f1/fc1fb2cfd82b47beb4fc4035752689ae 2023-02-11 22:03:29,206 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/.tmp/f1/fd87af44aed44a66a52ad47340c21862 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f1/fd87af44aed44a66a52ad47340c21862 2023-02-11 22:03:29,210 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f1/70625b60fa6c44bf9f7b815b46658a9d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:29,212 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/.tmp/f2/1f7c21213a1b499fbffa2356255dbd5c as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f2/1f7c21213a1b499fbffa2356255dbd5c 2023-02-11 22:03:29,214 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f1/fd87af44aed44a66a52ad47340c21862, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:29,214 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/.tmp/f1/56e85504cecd487ba9480df89349c1a9 2023-02-11 22:03:29,215 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/.tmp/f2/d5fa3a6ee0c1489b9b76252d2829d5f4 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f2/d5fa3a6ee0c1489b9b76252d2829d5f4 2023-02-11 22:03:29,216 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/.tmp/f2/fb1418ef31c7418598dce00926a3d055 2023-02-11 22:03:29,216 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f1/fc1fb2cfd82b47beb4fc4035752689ae, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:29,218 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/.tmp/f2/86c831e23a9e428f970c86b92652cb30 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f2/86c831e23a9e428f970c86b92652cb30 2023-02-11 22:03:29,220 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f2/1f7c21213a1b499fbffa2356255dbd5c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:29,221 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1831fcd6b7e2a5995e84df12185098d9 in 180ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:29,221 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1831fcd6b7e2a5995e84df12185098d9: 2023-02-11 22:03:29,222 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:29,222 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:29,222 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 22:03:29,222 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. started... 2023-02-11 22:03:29,222 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:29,226 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f2/86c831e23a9e428f970c86b92652cb30, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:29,227 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f2/d5fa3a6ee0c1489b9b76252d2829d5f4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:29,227 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 729a58db7fb4592c77e2cc4df3adde86 in 185ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:29,227 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 729a58db7fb4592c77e2cc4df3adde86: 2023-02-11 22:03:29,227 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:29,227 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 22:03:29,228 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 00feacf3c0d364343957248be8b643ba in 187ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:29,228 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 00feacf3c0d364343957248be8b643ba: 2023-02-11 22:03:29,228 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:29,228 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 22:03:29,229 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/.tmp/f1/eaf8e601f28d46f392903bb9eb969b40 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f1/eaf8e601f28d46f392903bb9eb969b40 2023-02-11 22:03:29,234 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f1/eaf8e601f28d46f392903bb9eb969b40, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:29,235 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/.tmp/f2/fb1418ef31c7418598dce00926a3d055 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f2/fb1418ef31c7418598dce00926a3d055 2023-02-11 22:03:29,245 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f2/fb1418ef31c7418598dce00926a3d055, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:29,246 INFO [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cb70f48b8da268def615f833e60d23f4 in 193ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:29,246 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cb70f48b8da268def615f833e60d23f4: 2023-02-11 22:03:29,246 DEBUG [rs(jenkins-hbase9.apache.org,46823,1676153004617)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:29,246 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 22:03:29,246 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 22:03:29,246 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,252 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 22:03:29,253 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46823,1676153004617' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 22:03:29,255 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,255 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:29,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:29,256 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,256 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:29,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:29,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:29,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:29,257 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/.tmp/f1/bf11d163f16e456696be4ccade6d0219 2023-02-11 22:03:29,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:29,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46823,1676153004617' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 22:03:29,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27b940e3[Count = 1] remaining members to acquire global barrier 2023-02-11 22:03:29,277 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/.tmp/f2/95b51bd312ff4f9a878c27da7ed99965 2023-02-11 22:03:29,284 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/.tmp/f1/bf11d163f16e456696be4ccade6d0219 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f1/bf11d163f16e456696be4ccade6d0219 2023-02-11 22:03:29,289 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f1/bf11d163f16e456696be4ccade6d0219, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:29,290 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/.tmp/f2/95b51bd312ff4f9a878c27da7ed99965 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f2/95b51bd312ff4f9a878c27da7ed99965 2023-02-11 22:03:29,294 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f2/95b51bd312ff4f9a878c27da7ed99965, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:29,296 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e in 74ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:29,296 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e: 2023-02-11 22:03:29,296 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:29,296 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 22:03:29,657 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/.tmp/f2/7f0663212d814537a89a2b71c43cd7cc 2023-02-11 22:03:29,662 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/.tmp/f1/56e85504cecd487ba9480df89349c1a9 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f1/56e85504cecd487ba9480df89349c1a9 2023-02-11 22:03:29,667 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f1/56e85504cecd487ba9480df89349c1a9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 22:03:29,668 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/.tmp/f2/7f0663212d814537a89a2b71c43cd7cc as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f2/7f0663212d814537a89a2b71c43cd7cc 2023-02-11 22:03:29,672 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f2/7f0663212d814537a89a2b71c43cd7cc, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 22:03:29,673 INFO [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for fe57fb58d8f76892415e2213259fe152 in 490ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:29,673 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe57fb58d8f76892415e2213259fe152: 2023-02-11 22:03:29,673 DEBUG [rs(jenkins-hbase9.apache.org,39829,1676153004496)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:29,673 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 22:03:29,673 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 22:03:29,673 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,673 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 22:03:29,673 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39829,1676153004496' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 22:03:29,675 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,675 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:29,675 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:29,675 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:29,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39829,1676153004496' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 22:03:29,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27b940e3[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:29,677 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-11 22:03:29,677 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,679 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,679 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,679 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,679 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 22:03:29,679 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 22:03:29,679 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 22:03:29,679 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 22:03:29,679 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,46823,1676153004617' in zk 2023-02-11 22:03:29,679 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,39829,1676153004496' in zk 2023-02-11 22:03:29,680 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,680 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:29,681 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,681 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 22:03:29,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:29,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:29,681 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:29,681 DEBUG [member: 'jenkins-hbase9.apache.org,39829,1676153004496' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 22:03:29,682 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 22:03:29,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:29,682 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,682 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:29,682 DEBUG [member: 'jenkins-hbase9.apache.org,46823,1676153004617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 22:03:29,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:29,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:29,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:29,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:29,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,39829,1676153004496': 2023-02-11 22:03:29,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39829,1676153004496' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-11 22:03:29,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:29,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:29,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:29,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:29,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:29,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,46823,1676153004617': 2023-02-11 22:03:29,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46823,1676153004617' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-11 22:03:29,688 INFO [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-11 22:03:29,688 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:29,688 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:29,688 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-11 22:03:29,689 INFO [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 22:03:29,690 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,690 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,690 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:29,690 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:29,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,690 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:29,691 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:29,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:29,691 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:29,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:29,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:29,693 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:29,693 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,697 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,697 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:29,697 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:29,697 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:29,697 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:29,697 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:29,697 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:29,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-11 22:03:29,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 22:03:29,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:29,697 DEBUG [(jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:29,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:29,697 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:29,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:29,698 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,698 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,698 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,698 DEBUG [Listener at localhost/34985] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:29,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:29,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:29,698 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:29,699 DEBUG [Listener at localhost/34985] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 22:03:29,699 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:29,799 DEBUG [Listener at localhost/34985] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 22:03:29,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38277] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 22:03:29,801 INFO [Listener at localhost/34985] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 22:03:29,802 DEBUG [Listener at localhost/34985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33fff870 to 127.0.0.1:53876 2023-02-11 22:03:29,802 DEBUG [Listener at localhost/34985] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:29,802 DEBUG [Listener at localhost/34985] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 22:03:29,802 DEBUG [Listener at localhost/34985] util.JVMClusterUtil(257): Found active master hash=487003374, stopped=false 2023-02-11 22:03:29,802 INFO [Listener at localhost/34985] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,38277,1676153004428 2023-02-11 22:03:29,804 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:29,804 INFO [Listener at localhost/34985] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 22:03:29,804 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:29,804 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:29,806 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:29,806 DEBUG [Listener at localhost/34985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e541e1d to 127.0.0.1:53876 2023-02-11 22:03:29,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:29,807 DEBUG [Listener at localhost/34985] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:29,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:29,807 INFO [Listener at localhost/34985] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,39829,1676153004496' ***** 2023-02-11 22:03:29,807 INFO [Listener at localhost/34985] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:29,807 INFO [Listener at localhost/34985] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,46823,1676153004617' ***** 2023-02-11 22:03:29,807 INFO [Listener at localhost/34985] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:29,807 INFO [RS:0;jenkins-hbase9:39829] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:29,807 INFO [RS:1;jenkins-hbase9:46823] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:29,807 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:29,807 INFO [RS:1;jenkins-hbase9:46823] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:29,807 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:29,808 INFO [RS:0;jenkins-hbase9:39829] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:29,809 INFO [RS:1;jenkins-hbase9:46823] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:29,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:29,809 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(3304): Received CLOSE for 729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:29,809 INFO [RS:0;jenkins-hbase9:39829] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:29,809 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(3304): Received CLOSE for a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:29,809 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(3304): Received CLOSE for 486c71946d36ff5e4572900863d06748 2023-02-11 22:03:29,809 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(3304): Received CLOSE for cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:29,809 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(3304): Received CLOSE for 1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:29,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing a12cce4691f2804e26ca94cccb4c0336, disabling compactions & flushes 2023-02-11 22:03:29,810 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(3304): Received CLOSE for 00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:29,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:29,810 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(3304): Received CLOSE for fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:29,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:29,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 729a58db7fb4592c77e2cc4df3adde86, disabling compactions & flushes 2023-02-11 22:03:29,809 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(3304): Received CLOSE for f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:29,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:29,810 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(3304): Received CLOSE for c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:29,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. after waiting 0 ms 2023-02-11 22:03:29,810 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(3304): Received CLOSE for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:29,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:29,810 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(3304): Received CLOSE for c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:29,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:29,810 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:29,810 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:29,810 DEBUG [RS:1;jenkins-hbase9:46823] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ef25f25 to 127.0.0.1:53876 2023-02-11 22:03:29,810 DEBUG [RS:0;jenkins-hbase9:39829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a50219d to 127.0.0.1:53876 2023-02-11 22:03:29,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. after waiting 0 ms 2023-02-11 22:03:29,810 DEBUG [RS:0;jenkins-hbase9:39829] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:29,810 DEBUG [RS:1;jenkins-hbase9:46823] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:29,810 INFO [RS:0;jenkins-hbase9:39829] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:29,811 INFO [RS:0;jenkins-hbase9:39829] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:29,811 INFO [RS:0;jenkins-hbase9:39829] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:29,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:29,812 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:29,811 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 22:03:29,811 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-11 22:03:29,813 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:29,813 DEBUG [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(1479): Online Regions={729a58db7fb4592c77e2cc4df3adde86=testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86., 486c71946d36ff5e4572900863d06748=hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748., cb70f48b8da268def615f833e60d23f4=testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4., f69c06b1b31a25e7c17175f781c3185b=testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b., c9c7af6c79927f83f8f93a4b2e508645=testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645., c8679eb44c4f2cd6567038643bfd5839=testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839.} 2023-02-11 22:03:29,814 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:29,813 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-11 22:03:29,814 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:29,814 DEBUG [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(1505): Waiting on 486c71946d36ff5e4572900863d06748, 729a58db7fb4592c77e2cc4df3adde86, c8679eb44c4f2cd6567038643bfd5839, c9c7af6c79927f83f8f93a4b2e508645, cb70f48b8da268def615f833e60d23f4, f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:29,814 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:29,814 DEBUG [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(1479): Online Regions={a12cce4691f2804e26ca94cccb4c0336=testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336., 1588230740=hbase:meta,,1.1588230740, 1831fcd6b7e2a5995e84df12185098d9=testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9., 00feacf3c0d364343957248be8b643ba=testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba., fe57fb58d8f76892415e2213259fe152=testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152., 12b8f2259ac6e3ab0ee8ddf4b01c4b9e=testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e.} 2023-02-11 22:03:29,814 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:29,814 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:29,814 DEBUG [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(1505): Waiting on 00feacf3c0d364343957248be8b643ba, 12b8f2259ac6e3ab0ee8ddf4b01c4b9e, 1588230740, 1831fcd6b7e2a5995e84df12185098d9, a12cce4691f2804e26ca94cccb4c0336, fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:29,814 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-11 22:03:29,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:29,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:29,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:29,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for a12cce4691f2804e26ca94cccb4c0336: Waiting for close lock at 1676153009810Running coprocessor pre-close hooks at 1676153009810Disabling compacts and flushes for region at 1676153009810Disabling writes for close at 1676153009810Writing region close event to WAL at 1676153009818 (+8 ms)Running coprocessor post-close hooks at 1676153009824 (+6 ms)Closed at 1676153009824 2023-02-11 22:03:29,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:29,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1831fcd6b7e2a5995e84df12185098d9, disabling compactions & flushes 2023-02-11 22:03:29,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:29,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:29,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. after waiting 0 ms 2023-02-11 22:03:29,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:29,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:29,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 729a58db7fb4592c77e2cc4df3adde86: Waiting for close lock at 1676153009809Running coprocessor pre-close hooks at 1676153009809Disabling compacts and flushes for region at 1676153009809Disabling writes for close at 1676153009810 (+1 ms)Writing region close event to WAL at 1676153009821 (+11 ms)Running coprocessor post-close hooks at 1676153009825 (+4 ms)Closed at 1676153009826 (+1 ms) 2023-02-11 22:03:29,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:29,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 486c71946d36ff5e4572900863d06748, disabling compactions & flushes 2023-02-11 22:03:29,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. 2023-02-11 22:03:29,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. 2023-02-11 22:03:29,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. after waiting 0 ms 2023-02-11 22:03:29,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. 2023-02-11 22:03:29,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 486c71946d36ff5e4572900863d06748 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 22:03:29,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:29,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:29,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/.tmp/info/99086e23965b48429c201e8d5a1edd53 2023-02-11 22:03:29,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1831fcd6b7e2a5995e84df12185098d9: Waiting for close lock at 1676153009825Running coprocessor pre-close hooks at 1676153009825Disabling compacts and flushes for region at 1676153009825Disabling writes for close at 1676153009825Writing region close event to WAL at 1676153009832 (+7 ms)Running coprocessor post-close hooks at 1676153009839 (+7 ms)Closed at 1676153009839 2023-02-11 22:03:29,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:29,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 00feacf3c0d364343957248be8b643ba, disabling compactions & flushes 2023-02-11 22:03:29,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:29,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:29,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. after waiting 0 ms 2023-02-11 22:03:29,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:29,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/namespace/486c71946d36ff5e4572900863d06748/.tmp/info/bad6389811d440728aa8813f8aa19c0e 2023-02-11 22:03:29,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:29,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:29,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 00feacf3c0d364343957248be8b643ba: Waiting for close lock at 1676153009840Running coprocessor pre-close hooks at 1676153009840Disabling compacts and flushes for region at 1676153009840Disabling writes for close at 1676153009840Writing region close event to WAL at 1676153009850 (+10 ms)Running coprocessor post-close hooks at 1676153009854 (+4 ms)Closed at 1676153009854 2023-02-11 22:03:29,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:29,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing fe57fb58d8f76892415e2213259fe152, disabling compactions & flushes 2023-02-11 22:03:29,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:29,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:29,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. after waiting 0 ms 2023-02-11 22:03:29,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:29,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/namespace/486c71946d36ff5e4572900863d06748/.tmp/info/bad6389811d440728aa8813f8aa19c0e as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/namespace/486c71946d36ff5e4572900863d06748/info/bad6389811d440728aa8813f8aa19c0e 2023-02-11 22:03:29,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/namespace/486c71946d36ff5e4572900863d06748/info/bad6389811d440728aa8813f8aa19c0e, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 22:03:29,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 486c71946d36ff5e4572900863d06748 in 37ms, sequenceid=6, compaction requested=false 2023-02-11 22:03:29,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-11 22:03:29,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:29,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:29,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for fe57fb58d8f76892415e2213259fe152: Waiting for close lock at 1676153009854Running coprocessor pre-close hooks at 1676153009854Disabling compacts and flushes for region at 1676153009854Disabling writes for close at 1676153009855 (+1 ms)Writing region close event to WAL at 1676153009856 (+1 ms)Running coprocessor post-close hooks at 1676153009867 (+11 ms)Closed at 1676153009868 (+1 ms) 2023-02-11 22:03:29,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:29,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 12b8f2259ac6e3ab0ee8ddf4b01c4b9e, disabling compactions & flushes 2023-02-11 22:03:29,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:29,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:29,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. after waiting 0 ms 2023-02-11 22:03:29,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:29,870 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/.tmp/table/f1c4261b41774d87a5be7d0c726e059c 2023-02-11 22:03:29,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/namespace/486c71946d36ff5e4572900863d06748/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 22:03:29,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. 2023-02-11 22:03:29,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 486c71946d36ff5e4572900863d06748: Waiting for close lock at 1676153009826Running coprocessor pre-close hooks at 1676153009826Disabling compacts and flushes for region at 1676153009826Disabling writes for close at 1676153009826Obtaining lock to block concurrent updates at 1676153009826Preparing flush snapshotting stores in 486c71946d36ff5e4572900863d06748 at 1676153009826Finished memstore snapshotting hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676153009827 (+1 ms)Flushing stores of hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. at 1676153009829 (+2 ms)Flushing 486c71946d36ff5e4572900863d06748/info: creating writer at 1676153009829Flushing 486c71946d36ff5e4572900863d06748/info: appending metadata at 1676153009834 (+5 ms)Flushing 486c71946d36ff5e4572900863d06748/info: closing flushed file at 1676153009834Flushing 486c71946d36ff5e4572900863d06748/info: reopening flushed file at 1676153009856 (+22 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 486c71946d36ff5e4572900863d06748 in 37ms, sequenceid=6, compaction requested=false at 1676153009863 (+7 ms)Writing region close event to WAL at 1676153009867 (+4 ms)Running coprocessor post-close hooks at 1676153009872 (+5 ms)Closed at 1676153009872 2023-02-11 22:03:29,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676153005638.486c71946d36ff5e4572900863d06748. 2023-02-11 22:03:29,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing cb70f48b8da268def615f833e60d23f4, disabling compactions & flushes 2023-02-11 22:03:29,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:29,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:29,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. after waiting 0 ms 2023-02-11 22:03:29,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:29,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:29,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:29,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e: Waiting for close lock at 1676153009868Running coprocessor pre-close hooks at 1676153009868Disabling compacts and flushes for region at 1676153009868Disabling writes for close at 1676153009868Writing region close event to WAL at 1676153009870 (+2 ms)Running coprocessor post-close hooks at 1676153009875 (+5 ms)Closed at 1676153009875 2023-02-11 22:03:29,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:29,877 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/.tmp/info/99086e23965b48429c201e8d5a1edd53 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/info/99086e23965b48429c201e8d5a1edd53 2023-02-11 22:03:29,882 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/info/99086e23965b48429c201e8d5a1edd53, entries=110, sequenceid=32, filesize=18.7 K 2023-02-11 22:03:29,883 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/.tmp/table/f1c4261b41774d87a5be7d0c726e059c as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/table/f1c4261b41774d87a5be7d0c726e059c 2023-02-11 22:03:29,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:29,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:29,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for cb70f48b8da268def615f833e60d23f4: Waiting for close lock at 1676153009873Running coprocessor pre-close hooks at 1676153009873Disabling compacts and flushes for region at 1676153009873Disabling writes for close at 1676153009873Writing region close event to WAL at 1676153009875 (+2 ms)Running coprocessor post-close hooks at 1676153009884 (+9 ms)Closed at 1676153009885 (+1 ms) 2023-02-11 22:03:29,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:29,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing f69c06b1b31a25e7c17175f781c3185b, disabling compactions & flushes 2023-02-11 22:03:29,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:29,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:29,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. after waiting 0 ms 2023-02-11 22:03:29,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:29,889 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/table/f1c4261b41774d87a5be7d0c726e059c, entries=4, sequenceid=32, filesize=4.8 K 2023-02-11 22:03:29,890 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=32, compaction requested=false 2023-02-11 22:03:29,890 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-11 22:03:29,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:29,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:29,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for f69c06b1b31a25e7c17175f781c3185b: Waiting for close lock at 1676153009886Running coprocessor pre-close hooks at 1676153009886Disabling compacts and flushes for region at 1676153009886Disabling writes for close at 1676153009886Writing region close event to WAL at 1676153009888 (+2 ms)Running coprocessor post-close hooks at 1676153009893 (+5 ms)Closed at 1676153009893 2023-02-11 22:03:29,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:29,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing c9c7af6c79927f83f8f93a4b2e508645, disabling compactions & flushes 2023-02-11 22:03:29,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:29,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:29,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. after waiting 0 ms 2023-02-11 22:03:29,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:29,897 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-11 22:03:29,897 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 22:03:29,897 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:29,897 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153009814Running coprocessor pre-close hooks at 1676153009814Disabling compacts and flushes for region at 1676153009814Disabling writes for close at 1676153009814Obtaining lock to block concurrent updates at 1676153009815 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676153009815Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676153009818 (+3 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676153009819 (+1 ms)Flushing 1588230740/info: creating writer at 1676153009819Flushing 1588230740/info: appending metadata at 1676153009824 (+5 ms)Flushing 1588230740/info: closing flushed file at 1676153009824Flushing 1588230740/table: creating writer at 1676153009853 (+29 ms)Flushing 1588230740/table: appending metadata at 1676153009855 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676153009855Flushing 1588230740/info: reopening flushed file at 1676153009878 (+23 ms)Flushing 1588230740/table: reopening flushed file at 1676153009883 (+5 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=32, compaction requested=false at 1676153009890 (+7 ms)Writing region close event to WAL at 1676153009891 (+1 ms)Running coprocessor post-close hooks at 1676153009897 (+6 ms)Closed at 1676153009897 2023-02-11 22:03:29,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 22:03:29,897 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:29,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:29,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for c9c7af6c79927f83f8f93a4b2e508645: Waiting for close lock at 1676153009893Running coprocessor pre-close hooks at 1676153009893Disabling compacts and flushes for region at 1676153009893Disabling writes for close at 1676153009893Writing region close event to WAL at 1676153009894 (+1 ms)Running coprocessor post-close hooks at 1676153009898 (+4 ms)Closed at 1676153009898 2023-02-11 22:03:29,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:29,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing c8679eb44c4f2cd6567038643bfd5839, disabling compactions & flushes 2023-02-11 22:03:29,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:29,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:29,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. after waiting 0 ms 2023-02-11 22:03:29,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:29,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 22:03:29,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:29,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for c8679eb44c4f2cd6567038643bfd5839: Waiting for close lock at 1676153009898Running coprocessor pre-close hooks at 1676153009898Disabling compacts and flushes for region at 1676153009898Disabling writes for close at 1676153009898Writing region close event to WAL at 1676153009899 (+1 ms)Running coprocessor post-close hooks at 1676153009902 (+3 ms)Closed at 1676153009902 2023-02-11 22:03:29,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:30,014 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,46823,1676153004617; all regions closed. 2023-02-11 22:03:30,014 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,39829,1676153004496; all regions closed. 2023-02-11 22:03:30,019 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/WALs/jenkins-hbase9.apache.org,46823,1676153004617/jenkins-hbase9.apache.org%2C46823%2C1676153004617.1676153006012 not finished, retry = 0 2023-02-11 22:03:30,021 DEBUG [RS:0;jenkins-hbase9:39829] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/oldWALs 2023-02-11 22:03:30,021 INFO [RS:0;jenkins-hbase9:39829] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C39829%2C1676153004496.meta:.meta(num 1676153005553) 2023-02-11 22:03:30,025 DEBUG [RS:0;jenkins-hbase9:39829] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/oldWALs 2023-02-11 22:03:30,025 INFO [RS:0;jenkins-hbase9:39829] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C39829%2C1676153004496:(num 1676153006338) 2023-02-11 22:03:30,025 DEBUG [RS:0;jenkins-hbase9:39829] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:30,025 INFO [RS:0;jenkins-hbase9:39829] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:30,026 INFO [RS:0;jenkins-hbase9:39829] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:30,026 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:30,027 INFO [RS:0;jenkins-hbase9:39829] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39829 2023-02-11 22:03:30,029 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:30,029 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39829,1676153004496 2023-02-11 22:03:30,029 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:30,029 ERROR [Listener at localhost/34985-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@44aea870 rejected from java.util.concurrent.ThreadPoolExecutor@4091243d[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:30,029 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:30,029 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:30,029 ERROR [Listener at localhost/34985-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5009693 rejected from java.util.concurrent.ThreadPoolExecutor@4091243d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:30,030 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,39829,1676153004496] 2023-02-11 22:03:30,030 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,39829,1676153004496; numProcessing=1 2023-02-11 22:03:30,031 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,39829,1676153004496 already deleted, retry=false 2023-02-11 22:03:30,031 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,39829,1676153004496 expired; onlineServers=1 2023-02-11 22:03:30,122 DEBUG [RS:1;jenkins-hbase9:46823] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/oldWALs 2023-02-11 22:03:30,122 INFO [RS:1;jenkins-hbase9:46823] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C46823%2C1676153004617:(num 1676153006012) 2023-02-11 22:03:30,122 DEBUG [RS:1;jenkins-hbase9:46823] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:30,122 INFO [RS:1;jenkins-hbase9:46823] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:30,122 INFO [RS:1;jenkins-hbase9:46823] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:30,122 INFO [RS:1;jenkins-hbase9:46823] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:30,122 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:30,122 INFO [RS:1;jenkins-hbase9:46823] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:30,122 INFO [RS:1;jenkins-hbase9:46823] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:30,123 INFO [RS:1;jenkins-hbase9:46823] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:46823 2023-02-11 22:03:30,127 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,46823,1676153004617 2023-02-11 22:03:30,127 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:30,127 ERROR [Listener at localhost/34985-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e1e754d rejected from java.util.concurrent.ThreadPoolExecutor@1a21f256[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:30,128 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,46823,1676153004617] 2023-02-11 22:03:30,128 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,46823,1676153004617; numProcessing=2 2023-02-11 22:03:30,129 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,46823,1676153004617 already deleted, retry=false 2023-02-11 22:03:30,129 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,46823,1676153004617 expired; onlineServers=0 2023-02-11 22:03:30,129 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,38277,1676153004428' ***** 2023-02-11 22:03:30,129 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 22:03:30,130 DEBUG [M:0;jenkins-hbase9:38277] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c3a1ed5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:30,130 INFO [M:0;jenkins-hbase9:38277] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,38277,1676153004428 2023-02-11 22:03:30,130 INFO [M:0;jenkins-hbase9:38277] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,38277,1676153004428; all regions closed. 2023-02-11 22:03:30,130 DEBUG [M:0;jenkins-hbase9:38277] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:30,131 DEBUG [M:0;jenkins-hbase9:38277] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 22:03:30,131 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 22:03:30,131 DEBUG [M:0;jenkins-hbase9:38277] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 22:03:30,131 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153005128] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153005128,5,FailOnTimeoutGroup] 2023-02-11 22:03:30,131 INFO [M:0;jenkins-hbase9:38277] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 22:03:30,131 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:30,132 INFO [M:0;jenkins-hbase9:38277] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 22:03:30,132 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:30,131 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153005128] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153005128,5,FailOnTimeoutGroup] 2023-02-11 22:03:30,132 INFO [M:0;jenkins-hbase9:38277] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-11 22:03:30,132 DEBUG [M:0;jenkins-hbase9:38277] master.HMaster(1502): Stopping service threads 2023-02-11 22:03:30,133 INFO [M:0;jenkins-hbase9:38277] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 22:03:30,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:30,133 ERROR [M:0;jenkins-hbase9:38277] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 22:03:30,133 INFO [M:0;jenkins-hbase9:38277] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 22:03:30,133 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 22:03:30,134 DEBUG [M:0;jenkins-hbase9:38277] zookeeper.ZKUtil(398): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 22:03:30,134 WARN [M:0;jenkins-hbase9:38277] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 22:03:30,134 INFO [M:0;jenkins-hbase9:38277] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 22:03:30,134 INFO [M:0;jenkins-hbase9:38277] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 22:03:30,134 DEBUG [M:0;jenkins-hbase9:38277] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:30,135 INFO [M:0;jenkins-hbase9:38277] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:30,135 DEBUG [M:0;jenkins-hbase9:38277] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:30,135 DEBUG [M:0;jenkins-hbase9:38277] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:30,135 DEBUG [M:0;jenkins-hbase9:38277] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:30,135 INFO [M:0;jenkins-hbase9:38277] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-11 22:03:30,144 INFO [M:0;jenkins-hbase9:38277] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a31063b4a48044bb8e87f3d54a612c94 2023-02-11 22:03:30,149 DEBUG [M:0;jenkins-hbase9:38277] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a31063b4a48044bb8e87f3d54a612c94 as hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a31063b4a48044bb8e87f3d54a612c94 2023-02-11 22:03:30,153 INFO [M:0;jenkins-hbase9:38277] regionserver.HStore(1080): Added hdfs://localhost:44351/user/jenkins/test-data/1f996e0f-8d91-bfef-9f39-0d32e7d08307/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a31063b4a48044bb8e87f3d54a612c94, entries=31, sequenceid=218, filesize=9.0 K 2023-02-11 22:03:30,154 INFO [M:0;jenkins-hbase9:38277] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=218, compaction requested=false 2023-02-11 22:03:30,154 INFO [M:0;jenkins-hbase9:38277] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:30,154 DEBUG [M:0;jenkins-hbase9:38277] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153010134Disabling compacts and flushes for region at 1676153010134Disabling writes for close at 1676153010135 (+1 ms)Obtaining lock to block concurrent updates at 1676153010135Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676153010135Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103362, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676153010135Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676153010136 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676153010136Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676153010138 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676153010139 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676153010149 (+10 ms)Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=218, compaction requested=false at 1676153010154 (+5 ms)Writing region close event to WAL at 1676153010154Closed at 1676153010154 2023-02-11 22:03:30,159 INFO [M:0;jenkins-hbase9:38277] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 22:03:30,159 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:30,159 INFO [M:0;jenkins-hbase9:38277] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:38277 2023-02-11 22:03:30,163 DEBUG [M:0;jenkins-hbase9:38277] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,38277,1676153004428 already deleted, retry=false 2023-02-11 22:03:30,305 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:30,305 INFO [M:0;jenkins-hbase9:38277] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,38277,1676153004428; zookeeper connection closed. 2023-02-11 22:03:30,305 ERROR [Listener at localhost/34985-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2d82e42e rejected from java.util.concurrent.ThreadPoolExecutor@29bd6546[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:30,306 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): master:38277-0x100456a015c0000, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:30,306 ERROR [Listener at localhost/34985-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6700690a rejected from java.util.concurrent.ThreadPoolExecutor@29bd6546[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:30,405 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:30,405 INFO [RS:1;jenkins-hbase9:46823] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,46823,1676153004617; zookeeper connection closed. 2023-02-11 22:03:30,406 ERROR [Listener at localhost/34985-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@36fcd1d rejected from java.util.concurrent.ThreadPoolExecutor@1a21f256[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:30,406 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1801bf52] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1801bf52 2023-02-11 22:03:30,406 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:46823-0x100456a015c0002, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:30,406 ERROR [Listener at localhost/34985-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b9088f2 rejected from java.util.concurrent.ThreadPoolExecutor@1a21f256[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:30,506 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:30,506 INFO [RS:0;jenkins-hbase9:39829] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,39829,1676153004496; zookeeper connection closed. 2023-02-11 22:03:30,506 ERROR [Listener at localhost/34985-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7da52901 rejected from java.util.concurrent.ThreadPoolExecutor@4091243d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:30,506 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@600b89de] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@600b89de 2023-02-11 22:03:30,506 DEBUG [Listener at localhost/34985-EventThread] zookeeper.ZKWatcher(600): regionserver:39829-0x100456a015c0001, quorum=127.0.0.1:53876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:30,506 ERROR [Listener at localhost/34985-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6489fb2e rejected from java.util.concurrent.ThreadPoolExecutor@4091243d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:30,506 INFO [Listener at localhost/34985] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 22:03:30,593 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/hadoop-5976381137293393709.jar 2023-02-11 22:03:30,598 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676153007682 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:30,598 DEBUG [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(239): region to add: 729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(239): region to add: a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(239): region to add: cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(239): region to add: 00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(239): region to add: 1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(239): region to add: f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(239): region to add: c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(239): region to add: c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(239): region to add: fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(239): region to add: 12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(585): clone region=729a58db7fb4592c77e2cc4df3adde86 as 729a58db7fb4592c77e2cc4df3adde86 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(585): clone region=a12cce4691f2804e26ca94cccb4c0336 as a12cce4691f2804e26ca94cccb4c0336 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(585): clone region=cb70f48b8da268def615f833e60d23f4 as cb70f48b8da268def615f833e60d23f4 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:30,599 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(585): clone region=00feacf3c0d364343957248be8b643ba as 00feacf3c0d364343957248be8b643ba in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:30,600 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(585): clone region=1831fcd6b7e2a5995e84df12185098d9 as 1831fcd6b7e2a5995e84df12185098d9 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:30,600 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(585): clone region=f69c06b1b31a25e7c17175f781c3185b as f69c06b1b31a25e7c17175f781c3185b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:30,600 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(585): clone region=c9c7af6c79927f83f8f93a4b2e508645 as c9c7af6c79927f83f8f93a4b2e508645 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:30,600 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(585): clone region=c8679eb44c4f2cd6567038643bfd5839 as c8679eb44c4f2cd6567038643bfd5839 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:30,600 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(585): clone region=fe57fb58d8f76892415e2213259fe152 as fe57fb58d8f76892415e2213259fe152 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:30,600 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(585): clone region=12b8f2259ac6e3ab0ee8ddf4b01c4b9e as 12b8f2259ac6e3ab0ee8ddf4b01c4b9e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 22:03:30,601 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 729a58db7fb4592c77e2cc4df3adde86, NAME => 'testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21 2023-02-11 22:03:30,601 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => a12cce4691f2804e26ca94cccb4c0336, NAME => 'testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21 2023-02-11 22:03:30,602 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => cb70f48b8da268def615f833e60d23f4, NAME => 'testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21 2023-02-11 22:03:30,603 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 1831fcd6b7e2a5995e84df12185098d9, NAME => 'testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21 2023-02-11 22:03:30,603 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => f69c06b1b31a25e7c17175f781c3185b, NAME => 'testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21 2023-02-11 22:03:30,603 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 00feacf3c0d364343957248be8b643ba, NAME => 'testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21 2023-02-11 22:03:30,603 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => c9c7af6c79927f83f8f93a4b2e508645, NAME => 'testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21 2023-02-11 22:03:30,604 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => c8679eb44c4f2cd6567038643bfd5839, NAME => 'testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21 2023-02-11 22:03:30,627 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:30,627 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4bb0ec119ce04da290581c573e812ee0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,631 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:30,631 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5081356e20e9480aa7186dc2c2e2ce72 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,633 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:30,633 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0f0ed13e180049b5935d16916fe862ec from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,636 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 39c9f5e475ed4a24a555c429d5454e52 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,636 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:30,636 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:30,636 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing c8679eb44c4f2cd6567038643bfd5839, disabling compactions & flushes 2023-02-11 22:03:30,636 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 38d77e39a30543b1bf43a6aa847a29d2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,636 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:30,636 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:30,636 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. after waiting 0 ms 2023-02-11 22:03:30,636 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:30,637 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:30,637 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for c8679eb44c4f2cd6567038643bfd5839: Waiting for close lock at 1676153010636Disabling compacts and flushes for region at 1676153010636Disabling writes for close at 1676153010636Writing region close event to WAL at 1676153010637 (+1 ms)Closed at 1676153010637 2023-02-11 22:03:30,637 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => fe57fb58d8f76892415e2213259fe152, NAME => 'testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21 2023-02-11 22:03:30,638 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:30,638 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing c9c7af6c79927f83f8f93a4b2e508645, disabling compactions & flushes 2023-02-11 22:03:30,638 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:30,638 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:30,638 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. after waiting 0 ms 2023-02-11 22:03:30,638 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:30,638 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:30,638 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for c9c7af6c79927f83f8f93a4b2e508645: Waiting for close lock at 1676153010638Disabling compacts and flushes for region at 1676153010638Disabling writes for close at 1676153010638Writing region close event to WAL at 1676153010638Closed at 1676153010638 2023-02-11 22:03:30,639 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 12b8f2259ac6e3ab0ee8ddf4b01c4b9e, NAME => 'testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21 2023-02-11 22:03:30,641 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing a12cce4691f2804e26ca94cccb4c0336, disabling compactions & flushes 2023-02-11 22:03:30,641 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:30,641 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:30,641 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. after waiting 0 ms 2023-02-11 22:03:30,641 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:30,641 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:30,641 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for a12cce4691f2804e26ca94cccb4c0336: Waiting for close lock at 1676153010640Disabling compacts and flushes for region at 1676153010641 (+1 ms)Disabling writes for close at 1676153010641Writing region close event to WAL at 1676153010641Closed at 1676153010641 2023-02-11 22:03:30,647 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 09511af515854e7985d5dc670d393aef from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,647 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4999ef838618481fb001cfe4e1640833 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,648 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:30,648 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fb4ae4cf641d4185888bb0064520d6c7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,649 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 404a88af696d44699c592e647e1af4f9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,654 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:30,654 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e5bb40ccfe4b499996c354a86a053ef2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,659 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 00feacf3c0d364343957248be8b643ba, disabling compactions & flushes 2023-02-11 22:03:30,659 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:30,659 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:30,659 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. after waiting 0 ms 2023-02-11 22:03:30,659 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:30,659 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:30,659 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 00feacf3c0d364343957248be8b643ba: Waiting for close lock at 1676153010659Disabling compacts and flushes for region at 1676153010659Disabling writes for close at 1676153010659Writing region close event to WAL at 1676153010659Closed at 1676153010659 2023-02-11 22:03:30,659 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8affe3ae766643b59fd7ccf2032b32a0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,660 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing f69c06b1b31a25e7c17175f781c3185b, disabling compactions & flushes 2023-02-11 22:03:30,660 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:30,660 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:30,660 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. after waiting 0 ms 2023-02-11 22:03:30,660 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:30,660 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:30,660 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for f69c06b1b31a25e7c17175f781c3185b: Waiting for close lock at 1676153010660Disabling compacts and flushes for region at 1676153010660Disabling writes for close at 1676153010660Writing region close event to WAL at 1676153010660Closed at 1676153010660 2023-02-11 22:03:30,661 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 729a58db7fb4592c77e2cc4df3adde86, disabling compactions & flushes 2023-02-11 22:03:30,661 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 14743fd05ae549548b6a58b083bde645 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,661 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:30,661 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:30,661 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. after waiting 0 ms 2023-02-11 22:03:30,661 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:30,661 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:30,661 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 729a58db7fb4592c77e2cc4df3adde86: Waiting for close lock at 1676153010661Disabling compacts and flushes for region at 1676153010661Disabling writes for close at 1676153010661Writing region close event to WAL at 1676153010661Closed at 1676153010661 2023-02-11 22:03:30,662 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:30,662 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 42a4f9f7380943f9879f8de426f2c5f7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,663 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:30,663 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6971d2d1a61c4b6e8ef01b511a0497da from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,664 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 1831fcd6b7e2a5995e84df12185098d9, disabling compactions & flushes 2023-02-11 22:03:30,664 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:30,664 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:30,664 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. after waiting 0 ms 2023-02-11 22:03:30,664 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:30,664 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:30,664 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 1831fcd6b7e2a5995e84df12185098d9: Waiting for close lock at 1676153010664Disabling compacts and flushes for region at 1676153010664Disabling writes for close at 1676153010664Writing region close event to WAL at 1676153010664Closed at 1676153010664 2023-02-11 22:03:30,664 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing cb70f48b8da268def615f833e60d23f4, disabling compactions & flushes 2023-02-11 22:03:30,664 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:30,664 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:30,664 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. after waiting 0 ms 2023-02-11 22:03:30,664 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:30,664 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:30,664 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for cb70f48b8da268def615f833e60d23f4: Waiting for close lock at 1676153010664Disabling compacts and flushes for region at 1676153010664Disabling writes for close at 1676153010664Writing region close event to WAL at 1676153010664Closed at 1676153010664 2023-02-11 22:03:30,665 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3e1e9ed61f2844d590fc8dabb57474e4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,666 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 49cf8477658a4479bffaa8a51a51bcf4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 22:03:30,669 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 12b8f2259ac6e3ab0ee8ddf4b01c4b9e, disabling compactions & flushes 2023-02-11 22:03:30,669 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:30,669 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:30,669 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing fe57fb58d8f76892415e2213259fe152, disabling compactions & flushes 2023-02-11 22:03:30,669 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. after waiting 0 ms 2023-02-11 22:03:30,669 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:30,669 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:30,670 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:30,670 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:30,670 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. after waiting 0 ms 2023-02-11 22:03:30,670 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:30,670 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e: Waiting for close lock at 1676153010669Disabling compacts and flushes for region at 1676153010669Disabling writes for close at 1676153010669Writing region close event to WAL at 1676153010670 (+1 ms)Closed at 1676153010670 2023-02-11 22:03:30,670 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:30,670 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for fe57fb58d8f76892415e2213259fe152: Waiting for close lock at 1676153010669Disabling compacts and flushes for region at 1676153010669Disabling writes for close at 1676153010670 (+1 ms)Writing region close event to WAL at 1676153010670Closed at 1676153010670 2023-02-11 22:03:30,670 INFO [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676153007682 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:30,670 DEBUG [Listener at localhost/34985] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21 2023-02-11 22:03:30,670 DEBUG [Listener at localhost/34985] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21 2023-02-11 22:03:30,671 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-data/ 2023-02-11 22:03:30,671 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |----default/ 2023-02-11 22:03:30,672 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-11 22:03:30,672 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |----------00feacf3c0d364343957248be8b643ba/ 2023-02-11 22:03:30,673 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:30,673 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:30,673 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=00feacf3c0d364343957248be8b643ba-38d77e39a30543b1bf43a6aa847a29d2 2023-02-11 22:03:30,673 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:30,674 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=00feacf3c0d364343957248be8b643ba-09511af515854e7985d5dc670d393aef 2023-02-11 22:03:30,674 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |----------12b8f2259ac6e3ab0ee8ddf4b01c4b9e/ 2023-02-11 22:03:30,674 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:30,674 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:30,675 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=12b8f2259ac6e3ab0ee8ddf4b01c4b9e-42a4f9f7380943f9879f8de426f2c5f7 2023-02-11 22:03:30,675 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:30,675 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=12b8f2259ac6e3ab0ee8ddf4b01c4b9e-3e1e9ed61f2844d590fc8dabb57474e4 2023-02-11 22:03:30,675 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |----------1831fcd6b7e2a5995e84df12185098d9/ 2023-02-11 22:03:30,676 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:30,676 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:30,676 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=1831fcd6b7e2a5995e84df12185098d9-fb4ae4cf641d4185888bb0064520d6c7 2023-02-11 22:03:30,677 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:30,677 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=1831fcd6b7e2a5995e84df12185098d9-8affe3ae766643b59fd7ccf2032b32a0 2023-02-11 22:03:30,677 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |----------729a58db7fb4592c77e2cc4df3adde86/ 2023-02-11 22:03:30,677 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:30,678 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:30,678 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=729a58db7fb4592c77e2cc4df3adde86-5081356e20e9480aa7186dc2c2e2ce72 2023-02-11 22:03:30,678 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:30,678 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=729a58db7fb4592c77e2cc4df3adde86-4999ef838618481fb001cfe4e1640833 2023-02-11 22:03:30,679 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |----------a12cce4691f2804e26ca94cccb4c0336/ 2023-02-11 22:03:30,679 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:30,679 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:30,679 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=a12cce4691f2804e26ca94cccb4c0336-4bb0ec119ce04da290581c573e812ee0 2023-02-11 22:03:30,680 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:30,680 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=a12cce4691f2804e26ca94cccb4c0336-39c9f5e475ed4a24a555c429d5454e52 2023-02-11 22:03:30,680 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |----------c8679eb44c4f2cd6567038643bfd5839/ 2023-02-11 22:03:30,681 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:30,681 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |----------c9c7af6c79927f83f8f93a4b2e508645/ 2023-02-11 22:03:30,681 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:30,681 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |----------cb70f48b8da268def615f833e60d23f4/ 2023-02-11 22:03:30,681 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:30,681 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:30,682 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=cb70f48b8da268def615f833e60d23f4-e5bb40ccfe4b499996c354a86a053ef2 2023-02-11 22:03:30,682 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:30,682 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=cb70f48b8da268def615f833e60d23f4-14743fd05ae549548b6a58b083bde645 2023-02-11 22:03:30,682 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |----------f69c06b1b31a25e7c17175f781c3185b/ 2023-02-11 22:03:30,683 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:30,683 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:30,683 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=f69c06b1b31a25e7c17175f781c3185b-0f0ed13e180049b5935d16916fe862ec 2023-02-11 22:03:30,683 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:30,684 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=f69c06b1b31a25e7c17175f781c3185b-404a88af696d44699c592e647e1af4f9 2023-02-11 22:03:30,684 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |----------fe57fb58d8f76892415e2213259fe152/ 2023-02-11 22:03:30,684 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:30,684 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:30,685 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=fe57fb58d8f76892415e2213259fe152-6971d2d1a61c4b6e8ef01b511a0497da 2023-02-11 22:03:30,685 DEBUG [Listener at localhost/34985] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:30,685 DEBUG [Listener at localhost/34985] util.CommonFSUtils(702): |----------------testWithMapReduce=fe57fb58d8f76892415e2213259fe152-49cf8477658a4479bffaa8a51a51bcf4 2023-02-11 22:03:30,686 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,686 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,686 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,687 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,687 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,687 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,688 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,753 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/hadoop-2090863691938294197.jar 2023-02-11 22:03:30,754 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,754 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,754 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,755 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,755 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,755 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,756 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-11 22:03:30,756 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-11 22:03:30,757 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-11 22:03:30,757 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-11 22:03:30,757 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-11 22:03:30,758 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-11 22:03:30,758 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-11 22:03:30,758 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-11 22:03:30,759 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-11 22:03:30,759 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-11 22:03:30,760 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:30,760 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 22:03:30,760 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 22:03:30,760 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 22:03:30,761 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 22:03:30,827 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/hadoop-8624103428396117030.jar 2023-02-11 22:03:30,827 DEBUG [Listener at localhost/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 22:03:30,833 WARN [Listener at localhost/34985] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-11 22:03:30,862 INFO [Listener at localhost/34985] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 22:03:30,957 WARN [Listener at localhost/34985] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/mapreduce.cluster.local.dir/1676153010925/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-11 22:03:30,957 WARN [Listener at localhost/34985] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/mapreduce.cluster.local.dir/1676153010925/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-11 22:03:31,007 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:31,007 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:31,015 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:31,017 INFO [StoreOpener-00feacf3c0d364343957248be8b643ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:31,018 DEBUG [StoreOpener-00feacf3c0d364343957248be8b643ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f1 2023-02-11 22:03:31,019 INFO [StoreOpener-00feacf3c0d364343957248be8b643ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00feacf3c0d364343957248be8b643ba columnFamilyName f1 2023-02-11 22:03:31,024 DEBUG [StoreOpener-00feacf3c0d364343957248be8b643ba-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f1/testWithMapReduce=00feacf3c0d364343957248be8b643ba-38d77e39a30543b1bf43a6aa847a29d2 2023-02-11 22:03:31,024 INFO [StoreOpener-00feacf3c0d364343957248be8b643ba-1] regionserver.HStore(310): Store=00feacf3c0d364343957248be8b643ba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,024 INFO [StoreOpener-00feacf3c0d364343957248be8b643ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00feacf3c0d364343957248be8b643ba 2023-02-11 22:03:31,025 DEBUG [StoreOpener-00feacf3c0d364343957248be8b643ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f2 2023-02-11 22:03:31,025 INFO [StoreOpener-00feacf3c0d364343957248be8b643ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00feacf3c0d364343957248be8b643ba columnFamilyName f2 2023-02-11 22:03:31,030 DEBUG [StoreOpener-00feacf3c0d364343957248be8b643ba-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/00feacf3c0d364343957248be8b643ba/f2/testWithMapReduce=00feacf3c0d364343957248be8b643ba-09511af515854e7985d5dc670d393aef 2023-02-11 22:03:31,030 INFO [StoreOpener-00feacf3c0d364343957248be8b643ba-1] regionserver.HStore(310): Store=00feacf3c0d364343957248be8b643ba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:31,030 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 00feacf3c0d364343957248be8b643ba; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73446975, jitterRate=0.09444521367549896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:31,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 00feacf3c0d364343957248be8b643ba: Writing region info on filesystem at 1676153011015Initializing all the Stores at 1676153011016 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011016Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011016Region opened successfully at 1676153011030 (+14 ms) 2023-02-11 22:03:31,063 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 00feacf3c0d364343957248be8b643ba, disabling compactions & flushes 2023-02-11 22:03:31,064 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:31,064 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:31,064 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. after waiting 0 ms 2023-02-11 22:03:31,064 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:31,065 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676153006285.00feacf3c0d364343957248be8b643ba. 2023-02-11 22:03:31,065 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 00feacf3c0d364343957248be8b643ba: Waiting for close lock at 1676153011063Disabling compacts and flushes for region at 1676153011063Disabling writes for close at 1676153011064 (+1 ms)Writing region close event to WAL at 1676153011065 (+1 ms)Closed at 1676153011065 2023-02-11 22:03:31,069 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:31,069 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:31,070 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:31,072 INFO [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:31,072 DEBUG [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f1 2023-02-11 22:03:31,073 INFO [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12b8f2259ac6e3ab0ee8ddf4b01c4b9e columnFamilyName f1 2023-02-11 22:03:31,077 DEBUG [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f1/testWithMapReduce=12b8f2259ac6e3ab0ee8ddf4b01c4b9e-42a4f9f7380943f9879f8de426f2c5f7 2023-02-11 22:03:31,077 INFO [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] regionserver.HStore(310): Store=12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,077 INFO [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 12b8f2259ac6e3ab0ee8ddf4b01c4b9e 2023-02-11 22:03:31,078 DEBUG [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f2 2023-02-11 22:03:31,078 INFO [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12b8f2259ac6e3ab0ee8ddf4b01c4b9e columnFamilyName f2 2023-02-11 22:03:31,082 DEBUG [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f2/testWithMapReduce=12b8f2259ac6e3ab0ee8ddf4b01c4b9e-3e1e9ed61f2844d590fc8dabb57474e4 2023-02-11 22:03:31,082 INFO [StoreOpener-12b8f2259ac6e3ab0ee8ddf4b01c4b9e-1] regionserver.HStore(310): Store=12b8f2259ac6e3ab0ee8ddf4b01c4b9e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,083 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:31,083 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 12b8f2259ac6e3ab0ee8ddf4b01c4b9e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62590642, jitterRate=-0.06732675433158875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:31,083 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e: Writing region info on filesystem at 1676153011070Initializing all the Stores at 1676153011071 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011071Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011071Region opened successfully at 1676153011083 (+12 ms) 2023-02-11 22:03:31,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 12b8f2259ac6e3ab0ee8ddf4b01c4b9e, disabling compactions & flushes 2023-02-11 22:03:31,110 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:31,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:31,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. after waiting 0 ms 2023-02-11 22:03:31,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:31,111 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676153006285.12b8f2259ac6e3ab0ee8ddf4b01c4b9e. 2023-02-11 22:03:31,112 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 12b8f2259ac6e3ab0ee8ddf4b01c4b9e: Waiting for close lock at 1676153011110Disabling compacts and flushes for region at 1676153011110Disabling writes for close at 1676153011111 (+1 ms)Writing region close event to WAL at 1676153011111Closed at 1676153011111 2023-02-11 22:03:31,115 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:31,115 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:31,116 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:31,118 INFO [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:31,119 DEBUG [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f1 2023-02-11 22:03:31,119 INFO [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1831fcd6b7e2a5995e84df12185098d9 columnFamilyName f1 2023-02-11 22:03:31,124 DEBUG [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f1/testWithMapReduce=1831fcd6b7e2a5995e84df12185098d9-fb4ae4cf641d4185888bb0064520d6c7 2023-02-11 22:03:31,124 INFO [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] regionserver.HStore(310): Store=1831fcd6b7e2a5995e84df12185098d9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,124 INFO [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1831fcd6b7e2a5995e84df12185098d9 2023-02-11 22:03:31,125 DEBUG [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f2 2023-02-11 22:03:31,125 INFO [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1831fcd6b7e2a5995e84df12185098d9 columnFamilyName f2 2023-02-11 22:03:31,129 DEBUG [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/1831fcd6b7e2a5995e84df12185098d9/f2/testWithMapReduce=1831fcd6b7e2a5995e84df12185098d9-8affe3ae766643b59fd7ccf2032b32a0 2023-02-11 22:03:31,129 INFO [StoreOpener-1831fcd6b7e2a5995e84df12185098d9-1] regionserver.HStore(310): Store=1831fcd6b7e2a5995e84df12185098d9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:31,130 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1831fcd6b7e2a5995e84df12185098d9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59863542, jitterRate=-0.10796371102333069}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:31,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1831fcd6b7e2a5995e84df12185098d9: Writing region info on filesystem at 1676153011116Initializing all the Stores at 1676153011117 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011117Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011117Region opened successfully at 1676153011130 (+13 ms) 2023-02-11 22:03:31,166 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1831fcd6b7e2a5995e84df12185098d9, disabling compactions & flushes 2023-02-11 22:03:31,167 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:31,167 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:31,167 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. after waiting 0 ms 2023-02-11 22:03:31,167 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:31,168 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676153006285.1831fcd6b7e2a5995e84df12185098d9. 2023-02-11 22:03:31,168 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1831fcd6b7e2a5995e84df12185098d9: Waiting for close lock at 1676153011166Disabling compacts and flushes for region at 1676153011166Disabling writes for close at 1676153011167 (+1 ms)Writing region close event to WAL at 1676153011168 (+1 ms)Closed at 1676153011168 2023-02-11 22:03:31,172 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:31,172 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:31,173 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:31,175 INFO [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:31,177 DEBUG [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645/f1 2023-02-11 22:03:31,177 INFO [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9c7af6c79927f83f8f93a4b2e508645 columnFamilyName f1 2023-02-11 22:03:31,178 INFO [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] regionserver.HStore(310): Store=c9c7af6c79927f83f8f93a4b2e508645/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,178 INFO [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c9c7af6c79927f83f8f93a4b2e508645 2023-02-11 22:03:31,179 DEBUG [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/c9c7af6c79927f83f8f93a4b2e508645/f2 2023-02-11 22:03:31,180 INFO [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9c7af6c79927f83f8f93a4b2e508645 columnFamilyName f2 2023-02-11 22:03:31,180 INFO [StoreOpener-c9c7af6c79927f83f8f93a4b2e508645-1] regionserver.HStore(310): Store=c9c7af6c79927f83f8f93a4b2e508645/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,180 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:31,180 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c9c7af6c79927f83f8f93a4b2e508645; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58888765, jitterRate=-0.12248902022838593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:31,180 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c9c7af6c79927f83f8f93a4b2e508645: Writing region info on filesystem at 1676153011174Initializing all the Stores at 1676153011174Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011174Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011175 (+1 ms)Region opened successfully at 1676153011180 (+5 ms) 2023-02-11 22:03:31,197 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c9c7af6c79927f83f8f93a4b2e508645, disabling compactions & flushes 2023-02-11 22:03:31,197 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:31,197 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:31,197 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. after waiting 0 ms 2023-02-11 22:03:31,197 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:31,198 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676153006285.c9c7af6c79927f83f8f93a4b2e508645. 2023-02-11 22:03:31,198 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c9c7af6c79927f83f8f93a4b2e508645: Waiting for close lock at 1676153011197Disabling compacts and flushes for region at 1676153011197Disabling writes for close at 1676153011197Writing region close event to WAL at 1676153011198 (+1 ms)Closed at 1676153011198 2023-02-11 22:03:31,201 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:31,201 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:31,203 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:31,204 INFO [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:31,205 DEBUG [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f1 2023-02-11 22:03:31,206 INFO [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a12cce4691f2804e26ca94cccb4c0336 columnFamilyName f1 2023-02-11 22:03:31,210 DEBUG [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f1/testWithMapReduce=a12cce4691f2804e26ca94cccb4c0336-4bb0ec119ce04da290581c573e812ee0 2023-02-11 22:03:31,211 INFO [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] regionserver.HStore(310): Store=a12cce4691f2804e26ca94cccb4c0336/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,211 INFO [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a12cce4691f2804e26ca94cccb4c0336 2023-02-11 22:03:31,212 DEBUG [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f2 2023-02-11 22:03:31,212 INFO [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a12cce4691f2804e26ca94cccb4c0336 columnFamilyName f2 2023-02-11 22:03:31,217 DEBUG [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/a12cce4691f2804e26ca94cccb4c0336/f2/testWithMapReduce=a12cce4691f2804e26ca94cccb4c0336-39c9f5e475ed4a24a555c429d5454e52 2023-02-11 22:03:31,217 INFO [StoreOpener-a12cce4691f2804e26ca94cccb4c0336-1] regionserver.HStore(310): Store=a12cce4691f2804e26ca94cccb4c0336/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,217 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:31,217 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a12cce4691f2804e26ca94cccb4c0336; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68320214, jitterRate=0.01805052161216736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:31,217 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a12cce4691f2804e26ca94cccb4c0336: Writing region info on filesystem at 1676153011203Initializing all the Stores at 1676153011204 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011204Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011204Region opened successfully at 1676153011217 (+13 ms) 2023-02-11 22:03:31,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a12cce4691f2804e26ca94cccb4c0336, disabling compactions & flushes 2023-02-11 22:03:31,246 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:31,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:31,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. after waiting 0 ms 2023-02-11 22:03:31,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:31,247 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676153006285.a12cce4691f2804e26ca94cccb4c0336. 2023-02-11 22:03:31,247 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a12cce4691f2804e26ca94cccb4c0336: Waiting for close lock at 1676153011246Disabling compacts and flushes for region at 1676153011246Disabling writes for close at 1676153011246Writing region close event to WAL at 1676153011247 (+1 ms)Closed at 1676153011247 2023-02-11 22:03:31,251 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:31,251 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:31,254 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:31,255 INFO [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:31,256 DEBUG [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f1 2023-02-11 22:03:31,256 INFO [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 729a58db7fb4592c77e2cc4df3adde86 columnFamilyName f1 2023-02-11 22:03:31,261 DEBUG [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f1/testWithMapReduce=729a58db7fb4592c77e2cc4df3adde86-5081356e20e9480aa7186dc2c2e2ce72 2023-02-11 22:03:31,261 INFO [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] regionserver.HStore(310): Store=729a58db7fb4592c77e2cc4df3adde86/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,261 INFO [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 729a58db7fb4592c77e2cc4df3adde86 2023-02-11 22:03:31,262 DEBUG [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f2 2023-02-11 22:03:31,262 INFO [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 729a58db7fb4592c77e2cc4df3adde86 columnFamilyName f2 2023-02-11 22:03:31,266 DEBUG [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/729a58db7fb4592c77e2cc4df3adde86/f2/testWithMapReduce=729a58db7fb4592c77e2cc4df3adde86-4999ef838618481fb001cfe4e1640833 2023-02-11 22:03:31,266 INFO [StoreOpener-729a58db7fb4592c77e2cc4df3adde86-1] regionserver.HStore(310): Store=729a58db7fb4592c77e2cc4df3adde86/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,266 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:31,266 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 729a58db7fb4592c77e2cc4df3adde86; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59770121, jitterRate=-0.10935579240322113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:31,266 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 729a58db7fb4592c77e2cc4df3adde86: Writing region info on filesystem at 1676153011254Initializing all the Stores at 1676153011254Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011254Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011255 (+1 ms)Region opened successfully at 1676153011266 (+11 ms) 2023-02-11 22:03:31,295 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 729a58db7fb4592c77e2cc4df3adde86, disabling compactions & flushes 2023-02-11 22:03:31,295 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:31,295 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:31,295 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. after waiting 0 ms 2023-02-11 22:03:31,295 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:31,296 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676153006285.729a58db7fb4592c77e2cc4df3adde86. 2023-02-11 22:03:31,296 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 729a58db7fb4592c77e2cc4df3adde86: Waiting for close lock at 1676153011295Disabling compacts and flushes for region at 1676153011295Disabling writes for close at 1676153011295Writing region close event to WAL at 1676153011296 (+1 ms)Closed at 1676153011296 2023-02-11 22:03:31,299 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:31,299 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:31,300 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:31,303 INFO [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:31,304 DEBUG [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f1 2023-02-11 22:03:31,304 INFO [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f69c06b1b31a25e7c17175f781c3185b columnFamilyName f1 2023-02-11 22:03:31,309 DEBUG [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f1/testWithMapReduce=f69c06b1b31a25e7c17175f781c3185b-0f0ed13e180049b5935d16916fe862ec 2023-02-11 22:03:31,309 INFO [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] regionserver.HStore(310): Store=f69c06b1b31a25e7c17175f781c3185b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,309 INFO [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f69c06b1b31a25e7c17175f781c3185b 2023-02-11 22:03:31,310 DEBUG [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f2 2023-02-11 22:03:31,310 INFO [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f69c06b1b31a25e7c17175f781c3185b columnFamilyName f2 2023-02-11 22:03:31,314 DEBUG [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/f69c06b1b31a25e7c17175f781c3185b/f2/testWithMapReduce=f69c06b1b31a25e7c17175f781c3185b-404a88af696d44699c592e647e1af4f9 2023-02-11 22:03:31,315 INFO [StoreOpener-f69c06b1b31a25e7c17175f781c3185b-1] regionserver.HStore(310): Store=f69c06b1b31a25e7c17175f781c3185b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,315 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:31,315 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f69c06b1b31a25e7c17175f781c3185b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66824424, jitterRate=-0.004238486289978027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:31,315 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f69c06b1b31a25e7c17175f781c3185b: Writing region info on filesystem at 1676153011300Initializing all the Stores at 1676153011301 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011301Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011303 (+2 ms)Region opened successfully at 1676153011315 (+12 ms) 2023-02-11 22:03:31,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f69c06b1b31a25e7c17175f781c3185b, disabling compactions & flushes 2023-02-11 22:03:31,350 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:31,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:31,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. after waiting 0 ms 2023-02-11 22:03:31,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:31,351 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676153006285.f69c06b1b31a25e7c17175f781c3185b. 2023-02-11 22:03:31,351 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f69c06b1b31a25e7c17175f781c3185b: Waiting for close lock at 1676153011350Disabling compacts and flushes for region at 1676153011350Disabling writes for close at 1676153011350Writing region close event to WAL at 1676153011351 (+1 ms)Closed at 1676153011351 2023-02-11 22:03:31,354 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:31,354 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:31,359 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:31,361 INFO [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:31,362 DEBUG [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839/f1 2023-02-11 22:03:31,363 INFO [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8679eb44c4f2cd6567038643bfd5839 columnFamilyName f1 2023-02-11 22:03:31,363 INFO [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] regionserver.HStore(310): Store=c8679eb44c4f2cd6567038643bfd5839/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,363 INFO [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c8679eb44c4f2cd6567038643bfd5839 2023-02-11 22:03:31,364 DEBUG [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/c8679eb44c4f2cd6567038643bfd5839/f2 2023-02-11 22:03:31,365 INFO [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8679eb44c4f2cd6567038643bfd5839 columnFamilyName f2 2023-02-11 22:03:31,365 INFO [StoreOpener-c8679eb44c4f2cd6567038643bfd5839-1] regionserver.HStore(310): Store=c8679eb44c4f2cd6567038643bfd5839/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,365 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:31,365 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c8679eb44c4f2cd6567038643bfd5839; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62548968, jitterRate=-0.06794774532318115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:31,365 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c8679eb44c4f2cd6567038643bfd5839: Writing region info on filesystem at 1676153011360Initializing all the Stores at 1676153011360Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011360Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011360Region opened successfully at 1676153011365 (+5 ms) 2023-02-11 22:03:31,382 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c8679eb44c4f2cd6567038643bfd5839, disabling compactions & flushes 2023-02-11 22:03:31,382 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:31,382 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:31,382 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. after waiting 0 ms 2023-02-11 22:03:31,382 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:31,383 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676153006285.c8679eb44c4f2cd6567038643bfd5839. 2023-02-11 22:03:31,383 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c8679eb44c4f2cd6567038643bfd5839: Waiting for close lock at 1676153011382Disabling compacts and flushes for region at 1676153011382Disabling writes for close at 1676153011382Writing region close event to WAL at 1676153011383 (+1 ms)Closed at 1676153011383 2023-02-11 22:03:31,385 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:31,386 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:31,387 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:31,390 INFO [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:31,390 DEBUG [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f1 2023-02-11 22:03:31,391 INFO [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe57fb58d8f76892415e2213259fe152 columnFamilyName f1 2023-02-11 22:03:31,395 DEBUG [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f1/testWithMapReduce=fe57fb58d8f76892415e2213259fe152-6971d2d1a61c4b6e8ef01b511a0497da 2023-02-11 22:03:31,395 INFO [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] regionserver.HStore(310): Store=fe57fb58d8f76892415e2213259fe152/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,395 INFO [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fe57fb58d8f76892415e2213259fe152 2023-02-11 22:03:31,396 DEBUG [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f2 2023-02-11 22:03:31,396 INFO [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe57fb58d8f76892415e2213259fe152 columnFamilyName f2 2023-02-11 22:03:31,401 DEBUG [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/fe57fb58d8f76892415e2213259fe152/f2/testWithMapReduce=fe57fb58d8f76892415e2213259fe152-49cf8477658a4479bffaa8a51a51bcf4 2023-02-11 22:03:31,401 INFO [StoreOpener-fe57fb58d8f76892415e2213259fe152-1] regionserver.HStore(310): Store=fe57fb58d8f76892415e2213259fe152/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,401 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:31,401 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fe57fb58d8f76892415e2213259fe152; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71394191, jitterRate=0.0638563483953476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:31,401 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fe57fb58d8f76892415e2213259fe152: Writing region info on filesystem at 1676153011387Initializing all the Stores at 1676153011387Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011387Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011389 (+2 ms)Region opened successfully at 1676153011401 (+12 ms) 2023-02-11 22:03:31,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fe57fb58d8f76892415e2213259fe152, disabling compactions & flushes 2023-02-11 22:03:31,430 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:31,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:31,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. after waiting 0 ms 2023-02-11 22:03:31,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:31,431 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676153006285.fe57fb58d8f76892415e2213259fe152. 2023-02-11 22:03:31,431 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fe57fb58d8f76892415e2213259fe152: Waiting for close lock at 1676153011430Disabling compacts and flushes for region at 1676153011430Disabling writes for close at 1676153011430Writing region close event to WAL at 1676153011431 (+1 ms)Closed at 1676153011431 2023-02-11 22:03:31,434 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:31,434 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:31,436 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:31,438 INFO [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:31,439 DEBUG [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f1 2023-02-11 22:03:31,439 INFO [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb70f48b8da268def615f833e60d23f4 columnFamilyName f1 2023-02-11 22:03:31,447 DEBUG [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f1/testWithMapReduce=cb70f48b8da268def615f833e60d23f4-e5bb40ccfe4b499996c354a86a053ef2 2023-02-11 22:03:31,447 INFO [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] regionserver.HStore(310): Store=cb70f48b8da268def615f833e60d23f4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,447 INFO [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb70f48b8da268def615f833e60d23f4 2023-02-11 22:03:31,448 DEBUG [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f2 2023-02-11 22:03:31,449 INFO [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb70f48b8da268def615f833e60d23f4 columnFamilyName f2 2023-02-11 22:03:31,453 DEBUG [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] regionserver.HStore(539): loaded hdfs://localhost:44351/user/jenkins/test-data/f0bad568-848c-0802-0878-c41eab5810b9/testWithMapReduceAndOfflineHBaseMultiRegion/45787443-b95b-41f5-bf05-941621772a21/data/default/testWithMapReduce/cb70f48b8da268def615f833e60d23f4/f2/testWithMapReduce=cb70f48b8da268def615f833e60d23f4-14743fd05ae549548b6a58b083bde645 2023-02-11 22:03:31,453 INFO [StoreOpener-cb70f48b8da268def615f833e60d23f4-1] regionserver.HStore(310): Store=cb70f48b8da268def615f833e60d23f4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:31,453 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:31,455 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cb70f48b8da268def615f833e60d23f4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60753355, jitterRate=-0.09470446407794952}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:31,455 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cb70f48b8da268def615f833e60d23f4: Writing region info on filesystem at 1676153011436Initializing all the Stores at 1676153011437 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011437Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153011437Region opened successfully at 1676153011455 (+18 ms) 2023-02-11 22:03:31,486 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cb70f48b8da268def615f833e60d23f4, disabling compactions & flushes 2023-02-11 22:03:31,486 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:31,486 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:31,486 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. after waiting 0 ms 2023-02-11 22:03:31,486 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:31,487 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676153006285.cb70f48b8da268def615f833e60d23f4. 2023-02-11 22:03:31,487 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cb70f48b8da268def615f833e60d23f4: Waiting for close lock at 1676153011486Disabling compacts and flushes for region at 1676153011486Disabling writes for close at 1676153011486Writing region close event to WAL at 1676153011487 (+1 ms)Closed at 1676153011487 2023-02-11 22:03:32,005 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 22:03:32,006 WARN [Listener at localhost/34985] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:32,011 INFO [Listener at localhost/34985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:32,113 WARN [BP-487294756-172.31.2.10-1676153003808 heartbeating to localhost/127.0.0.1:44351] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:32,115 WARN [BP-487294756-172.31.2.10-1676153003808 heartbeating to localhost/127.0.0.1:44351] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-487294756-172.31.2.10-1676153003808 (Datanode Uuid 76d400f0-4a5a-41bc-9485-91a6a083d11c) service to localhost/127.0.0.1:44351 2023-02-11 22:03:32,119 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/cluster_344e9abb-1122-7a13-ff2c-3137bc719817/dfs/data/data3/current/BP-487294756-172.31.2.10-1676153003808] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:32,119 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/cluster_344e9abb-1122-7a13-ff2c-3137bc719817/dfs/data/data4/current/BP-487294756-172.31.2.10-1676153003808] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:32,121 WARN [Listener at localhost/34985] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:32,124 INFO [Listener at localhost/34985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:32,226 WARN [BP-487294756-172.31.2.10-1676153003808 heartbeating to localhost/127.0.0.1:44351] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:32,226 WARN [BP-487294756-172.31.2.10-1676153003808 heartbeating to localhost/127.0.0.1:44351] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-487294756-172.31.2.10-1676153003808 (Datanode Uuid 61e8cdef-2cc8-4a99-9b55-e89c921be14b) service to localhost/127.0.0.1:44351 2023-02-11 22:03:32,226 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/cluster_344e9abb-1122-7a13-ff2c-3137bc719817/dfs/data/data1/current/BP-487294756-172.31.2.10-1676153003808] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:32,227 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/cluster_344e9abb-1122-7a13-ff2c-3137bc719817/dfs/data/data2/current/BP-487294756-172.31.2.10-1676153003808] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:32,236 INFO [Listener at localhost/34985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:32,285 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 22:03:32,356 INFO [Listener at localhost/34985] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 22:03:32,406 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 22:03:32,422 INFO [Listener at localhost/34985] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=158 (was 104) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34985 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:44351 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:44351 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:44351 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase9.apache.org,38277,1676153004428)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:44351 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:44351 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:44351 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44351 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=537 (was 532) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=267 (was 279), ProcessCount=166 (was 166), AvailableMemoryMB=9729 (was 9934) 2023-02-11 22:03:32,434 INFO [Listener at localhost/34985] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=158, OpenFileDescriptor=537, MaxFileDescriptor=60000, SystemLoadAverage=267, ProcessCount=166, AvailableMemoryMB=9729 2023-02-11 22:03:32,444 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/hadoop.log.dir so I do NOT create it in target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc 2023-02-11 22:03:32,444 WARN [Listener at localhost/34985] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 22:03:32,444 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/hadoop.tmp.dir so I do NOT create it in target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc 2023-02-11 22:03:32,444 WARN [Listener at localhost/34985] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6a2fb82-46e5-5b82-19fa-5f36da51496a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 22:03:32,444 DEBUG [Listener at localhost/34985] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc 2023-02-11 22:03:32,444 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 22:03:32,444 INFO [Listener at localhost/34985] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/cluster_96b19853-4550-94fb-3f61-05f2411e3df4, deleteOnExit=true 2023-02-11 22:03:32,444 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 22:03:32,445 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/test.cache.data in system properties and HBase conf 2023-02-11 22:03:32,445 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 22:03:32,445 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/hadoop.log.dir in system properties and HBase conf 2023-02-11 22:03:32,445 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 22:03:32,445 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 22:03:32,445 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 22:03:32,445 DEBUG [Listener at localhost/34985] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 22:03:32,445 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:32,446 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:32,446 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 22:03:32,446 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:32,446 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 22:03:32,446 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 22:03:32,446 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:32,446 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:32,446 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 22:03:32,446 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/nfs.dump.dir in system properties and HBase conf 2023-02-11 22:03:32,446 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/java.io.tmpdir in system properties and HBase conf 2023-02-11 22:03:32,446 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:32,446 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 22:03:32,447 INFO [Listener at localhost/34985] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 22:03:32,451 WARN [Listener at localhost/34985] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:32,451 WARN [Listener at localhost/34985] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:32,486 WARN [Listener at localhost/34985] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:32,488 INFO [Listener at localhost/34985] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:32,493 INFO [Listener at localhost/34985] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/java.io.tmpdir/Jetty_localhost_45407_hdfs____b8gcec/webapp 2023-02-11 22:03:32,584 INFO [Listener at localhost/34985] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45407 2023-02-11 22:03:32,614 WARN [Listener at localhost/34985] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:32,614 WARN [Listener at localhost/34985] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:32,653 WARN [Listener at localhost/39523] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:32,669 WARN [Listener at localhost/39523] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:32,671 WARN [Listener at localhost/39523] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:32,672 INFO [Listener at localhost/39523] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:32,677 INFO [Listener at localhost/39523] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/java.io.tmpdir/Jetty_localhost_33613_datanode____l2lt9b/webapp 2023-02-11 22:03:32,769 INFO [Listener at localhost/39523] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33613 2023-02-11 22:03:32,778 WARN [Listener at localhost/34009] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:32,791 WARN [Listener at localhost/34009] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:32,794 WARN [Listener at localhost/34009] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:32,795 INFO [Listener at localhost/34009] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:32,801 INFO [Listener at localhost/34009] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/java.io.tmpdir/Jetty_localhost_37107_datanode____.6cj6yt/webapp 2023-02-11 22:03:32,875 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc95757a7155b1cbd: Processing first storage report for DS-4f3f9452-d4cd-4668-8395-2be933214297 from datanode 703dc352-3a07-468e-91ed-a5561c637cc3 2023-02-11 22:03:32,875 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc95757a7155b1cbd: from storage DS-4f3f9452-d4cd-4668-8395-2be933214297 node DatanodeRegistration(127.0.0.1:37425, datanodeUuid=703dc352-3a07-468e-91ed-a5561c637cc3, infoPort=43545, infoSecurePort=0, ipcPort=34009, storageInfo=lv=-57;cid=testClusterID;nsid=1199798762;c=1676153012453), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:32,875 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc95757a7155b1cbd: Processing first storage report for DS-6e6bd55e-7559-4d2c-a0d7-394a35116f5c from datanode 703dc352-3a07-468e-91ed-a5561c637cc3 2023-02-11 22:03:32,875 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc95757a7155b1cbd: from storage DS-6e6bd55e-7559-4d2c-a0d7-394a35116f5c node DatanodeRegistration(127.0.0.1:37425, datanodeUuid=703dc352-3a07-468e-91ed-a5561c637cc3, infoPort=43545, infoSecurePort=0, ipcPort=34009, storageInfo=lv=-57;cid=testClusterID;nsid=1199798762;c=1676153012453), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:32,909 INFO [Listener at localhost/34009] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37107 2023-02-11 22:03:32,923 WARN [Listener at localhost/42889] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:33,195 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb5363a41a670bf64: Processing first storage report for DS-0e7a6d41-8b0f-41f4-95b9-25d2ebf0ea09 from datanode 85da286c-74b6-4785-8733-19dc60139726 2023-02-11 22:03:33,195 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb5363a41a670bf64: from storage DS-0e7a6d41-8b0f-41f4-95b9-25d2ebf0ea09 node DatanodeRegistration(127.0.0.1:40115, datanodeUuid=85da286c-74b6-4785-8733-19dc60139726, infoPort=36135, infoSecurePort=0, ipcPort=42889, storageInfo=lv=-57;cid=testClusterID;nsid=1199798762;c=1676153012453), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:33,195 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb5363a41a670bf64: Processing first storage report for DS-330b7765-5d02-43ef-9737-6306748bd4e6 from datanode 85da286c-74b6-4785-8733-19dc60139726 2023-02-11 22:03:33,195 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb5363a41a670bf64: from storage DS-330b7765-5d02-43ef-9737-6306748bd4e6 node DatanodeRegistration(127.0.0.1:40115, datanodeUuid=85da286c-74b6-4785-8733-19dc60139726, infoPort=36135, infoSecurePort=0, ipcPort=42889, storageInfo=lv=-57;cid=testClusterID;nsid=1199798762;c=1676153012453), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:33,232 DEBUG [Listener at localhost/42889] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc 2023-02-11 22:03:33,234 INFO [Listener at localhost/42889] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/cluster_96b19853-4550-94fb-3f61-05f2411e3df4/zookeeper_0, clientPort=62800, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/cluster_96b19853-4550-94fb-3f61-05f2411e3df4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/cluster_96b19853-4550-94fb-3f61-05f2411e3df4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 22:03:33,235 INFO [Listener at localhost/42889] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62800 2023-02-11 22:03:33,236 INFO [Listener at localhost/42889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:33,236 INFO [Listener at localhost/42889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:33,249 INFO [Listener at localhost/42889] util.FSUtils(479): Created version file at hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518 with version=8 2023-02-11 22:03:33,249 INFO [Listener at localhost/42889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:33,249 INFO [Listener at localhost/42889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:33,250 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39523/user/jenkins/test-data/cfd0cd69-6344-0ad2-5bf6-df0a8433c040/hbase-staging 2023-02-11 22:03:33,252 INFO [Listener at localhost/42889] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:33,252 INFO [Listener at localhost/42889] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:33,252 INFO [Listener at localhost/42889] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:33,252 INFO [Listener at localhost/42889] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:33,252 INFO [Listener at localhost/42889] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:33,252 INFO [Listener at localhost/42889] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:33,253 INFO [Listener at localhost/42889] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:33,254 INFO [Listener at localhost/42889] ipc.NettyRpcServer(120): Bind to /172.31.2.10:37727 2023-02-11 22:03:33,254 INFO [Listener at localhost/42889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:33,255 INFO [Listener at localhost/42889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:33,256 INFO [Listener at localhost/42889] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37727 connecting to ZooKeeper ensemble=127.0.0.1:62800 2023-02-11 22:03:33,264 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:377270x0, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:33,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37727-0x100456a23e00000 connected 2023-02-11 22:03:33,280 DEBUG [Listener at localhost/42889] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:33,280 DEBUG [Listener at localhost/42889] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:33,281 DEBUG [Listener at localhost/42889] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:33,283 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37727 2023-02-11 22:03:33,283 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37727 2023-02-11 22:03:33,283 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37727 2023-02-11 22:03:33,286 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37727 2023-02-11 22:03:33,287 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37727 2023-02-11 22:03:33,287 INFO [Listener at localhost/42889] master.HMaster(439): hbase.rootdir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518, hbase.cluster.distributed=false 2023-02-11 22:03:33,299 INFO [Listener at localhost/42889] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:33,299 INFO [Listener at localhost/42889] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:33,299 INFO [Listener at localhost/42889] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:33,299 INFO [Listener at localhost/42889] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:33,299 INFO [Listener at localhost/42889] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:33,299 INFO [Listener at localhost/42889] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:33,299 INFO [Listener at localhost/42889] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:33,301 INFO [Listener at localhost/42889] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41239 2023-02-11 22:03:33,301 INFO [Listener at localhost/42889] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:33,303 DEBUG [Listener at localhost/42889] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:33,303 INFO [Listener at localhost/42889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:33,304 INFO [Listener at localhost/42889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:33,305 INFO [Listener at localhost/42889] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41239 connecting to ZooKeeper ensemble=127.0.0.1:62800 2023-02-11 22:03:33,308 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:412390x0, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:33,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41239-0x100456a23e00001 connected 2023-02-11 22:03:33,309 DEBUG [Listener at localhost/42889] zookeeper.ZKUtil(164): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:33,310 DEBUG [Listener at localhost/42889] zookeeper.ZKUtil(164): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:33,310 DEBUG [Listener at localhost/42889] zookeeper.ZKUtil(164): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:33,312 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41239 2023-02-11 22:03:33,315 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41239 2023-02-11 22:03:33,315 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41239 2023-02-11 22:03:33,315 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41239 2023-02-11 22:03:33,316 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41239 2023-02-11 22:03:33,326 INFO [Listener at localhost/42889] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:33,326 INFO [Listener at localhost/42889] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:33,326 INFO [Listener at localhost/42889] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:33,327 INFO [Listener at localhost/42889] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:33,327 INFO [Listener at localhost/42889] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:33,327 INFO [Listener at localhost/42889] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:33,327 INFO [Listener at localhost/42889] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:33,329 INFO [Listener at localhost/42889] ipc.NettyRpcServer(120): Bind to /172.31.2.10:46717 2023-02-11 22:03:33,330 INFO [Listener at localhost/42889] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:33,331 DEBUG [Listener at localhost/42889] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:33,331 INFO [Listener at localhost/42889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:33,332 INFO [Listener at localhost/42889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:33,333 INFO [Listener at localhost/42889] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46717 connecting to ZooKeeper ensemble=127.0.0.1:62800 2023-02-11 22:03:33,339 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:467170x0, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:33,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46717-0x100456a23e00002 connected 2023-02-11 22:03:33,342 DEBUG [Listener at localhost/42889] zookeeper.ZKUtil(164): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:33,342 DEBUG [Listener at localhost/42889] zookeeper.ZKUtil(164): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:33,343 DEBUG [Listener at localhost/42889] zookeeper.ZKUtil(164): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:33,347 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46717 2023-02-11 22:03:33,347 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46717 2023-02-11 22:03:33,348 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46717 2023-02-11 22:03:33,348 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46717 2023-02-11 22:03:33,349 DEBUG [Listener at localhost/42889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46717 2023-02-11 22:03:33,351 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,37727,1676153013252 2023-02-11 22:03:33,352 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:33,352 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,37727,1676153013252 2023-02-11 22:03:33,354 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:33,354 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:33,354 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:33,354 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:33,355 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:33,356 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,37727,1676153013252 from backup master directory 2023-02-11 22:03:33,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:33,357 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,37727,1676153013252 2023-02-11 22:03:33,357 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:33,357 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:33,357 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,37727,1676153013252 2023-02-11 22:03:33,371 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/hbase.id with ID: e90a07fc-047b-44ad-a78d-0b0022f10d41 2023-02-11 22:03:33,380 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:33,383 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:33,393 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4fd66f6c to 127.0.0.1:62800 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:33,398 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b77a36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:33,398 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:33,399 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 22:03:33,399 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:33,400 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/data/master/store-tmp 2023-02-11 22:03:33,408 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:33,408 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:33,408 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:33,408 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:33,408 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:33,408 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:33,408 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:33,408 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153013408Disabling compacts and flushes for region at 1676153013408Disabling writes for close at 1676153013408Writing region close event to WAL at 1676153013408Closed at 1676153013408 2023-02-11 22:03:33,409 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/WALs/jenkins-hbase9.apache.org,37727,1676153013252 2023-02-11 22:03:33,412 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37727%2C1676153013252, suffix=, logDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/WALs/jenkins-hbase9.apache.org,37727,1676153013252, archiveDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/oldWALs, maxLogs=10 2023-02-11 22:03:33,426 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37425,DS-4f3f9452-d4cd-4668-8395-2be933214297,DISK] 2023-02-11 22:03:33,427 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40115,DS-0e7a6d41-8b0f-41f4-95b9-25d2ebf0ea09,DISK] 2023-02-11 22:03:33,434 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/WALs/jenkins-hbase9.apache.org,37727,1676153013252/jenkins-hbase9.apache.org%2C37727%2C1676153013252.1676153013412 2023-02-11 22:03:33,434 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37425,DS-4f3f9452-d4cd-4668-8395-2be933214297,DISK], DatanodeInfoWithStorage[127.0.0.1:40115,DS-0e7a6d41-8b0f-41f4-95b9-25d2ebf0ea09,DISK]] 2023-02-11 22:03:33,434 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:33,434 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:33,434 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:33,434 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:33,437 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:33,438 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 22:03:33,438 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 22:03:33,439 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:33,439 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:33,440 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:33,442 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:33,443 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:33,444 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67878070, jitterRate=0.01146206259727478}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:33,444 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676153013434Initializing all the Stores at 1676153013435 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153013435Cleaning up temporary data from old regions at 1676153013440 (+5 ms)Cleaning up detritus from prior splits at 1676153013440Region opened successfully at 1676153013444 (+4 ms) 2023-02-11 22:03:33,444 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 22:03:33,445 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 22:03:33,445 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 22:03:33,446 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 22:03:33,446 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 22:03:33,446 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 22:03:33,446 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 22:03:33,447 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 22:03:33,448 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 22:03:33,458 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 22:03:33,458 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 22:03:33,459 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 22:03:33,459 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 22:03:33,459 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 22:03:33,461 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:33,461 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 22:03:33,461 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 22:03:33,462 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 22:03:33,463 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:33,463 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:33,463 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:33,463 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:33,464 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,37727,1676153013252, sessionid=0x100456a23e00000, setting cluster-up flag (Was=false) 2023-02-11 22:03:33,469 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:33,473 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 22:03:33,473 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,37727,1676153013252 2023-02-11 22:03:33,476 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:33,480 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 22:03:33,481 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,37727,1676153013252 2023-02-11 22:03:33,481 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.hbase-snapshot/.tmp 2023-02-11 22:03:33,483 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:33,483 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:33,483 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:33,483 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:33,483 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:33,483 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-11 22:03:33,483 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,483 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:33,483 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,485 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676153043485 2023-02-11 22:03:33,485 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 22:03:33,485 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 22:03:33,485 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 22:03:33,485 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 22:03:33,485 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 22:03:33,485 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 22:03:33,485 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,485 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:33,485 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 22:03:33,486 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 22:03:33,486 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 22:03:33,486 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 22:03:33,486 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 22:03:33,486 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 22:03:33,486 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153013486,5,FailOnTimeoutGroup] 2023-02-11 22:03:33,486 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153013486,5,FailOnTimeoutGroup] 2023-02-11 22:03:33,487 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,487 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 22:03:33,487 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,487 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,487 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:33,500 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:33,500 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:33,500 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518 2023-02-11 22:03:33,507 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:33,508 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:33,509 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/info 2023-02-11 22:03:33,509 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:33,510 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:33,510 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:33,511 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:33,511 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:33,511 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:33,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:33,512 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/table 2023-02-11 22:03:33,513 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:33,513 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:33,514 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740 2023-02-11 22:03:33,514 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740 2023-02-11 22:03:33,516 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:33,517 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:33,518 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:33,519 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74156571, jitterRate=0.10501901805400848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:33,519 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676153013507Initializing all the Stores at 1676153013508 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153013508Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153013508Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153013508Cleaning up temporary data from old regions at 1676153013515 (+7 ms)Cleaning up detritus from prior splits at 1676153013515Region opened successfully at 1676153013519 (+4 ms) 2023-02-11 22:03:33,519 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:33,519 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:33,519 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:33,519 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:33,519 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:33,519 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:33,519 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153013519Disabling compacts and flushes for region at 1676153013519Disabling writes for close at 1676153013519Writing region close event to WAL at 1676153013519Closed at 1676153013519 2023-02-11 22:03:33,520 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:33,520 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 22:03:33,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 22:03:33,522 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 22:03:33,523 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 22:03:33,551 INFO [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(952): ClusterId : e90a07fc-047b-44ad-a78d-0b0022f10d41 2023-02-11 22:03:33,552 DEBUG [RS:1;jenkins-hbase9:46717] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:33,552 INFO [RS:0;jenkins-hbase9:41239] regionserver.HRegionServer(952): ClusterId : e90a07fc-047b-44ad-a78d-0b0022f10d41 2023-02-11 22:03:33,552 DEBUG [RS:0;jenkins-hbase9:41239] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:33,554 DEBUG [RS:1;jenkins-hbase9:46717] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:33,554 DEBUG [RS:1;jenkins-hbase9:46717] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:33,554 DEBUG [RS:0;jenkins-hbase9:41239] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:33,554 DEBUG [RS:0;jenkins-hbase9:41239] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:33,557 DEBUG [RS:1;jenkins-hbase9:46717] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:33,558 DEBUG [RS:1;jenkins-hbase9:46717] zookeeper.ReadOnlyZKClient(139): Connect 0x06ef2268 to 127.0.0.1:62800 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:33,558 DEBUG [RS:0;jenkins-hbase9:41239] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:33,559 DEBUG [RS:0;jenkins-hbase9:41239] zookeeper.ReadOnlyZKClient(139): Connect 0x6f80988c to 127.0.0.1:62800 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:33,564 DEBUG [RS:1;jenkins-hbase9:46717] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@828dcc5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:33,564 DEBUG [RS:0;jenkins-hbase9:41239] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61476b0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:33,564 DEBUG [RS:1;jenkins-hbase9:46717] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c174918, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:33,564 DEBUG [RS:0;jenkins-hbase9:41239] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6578f3fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:33,573 DEBUG [RS:1;jenkins-hbase9:46717] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:46717 2023-02-11 22:03:33,573 INFO [RS:1;jenkins-hbase9:46717] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:33,573 INFO [RS:1;jenkins-hbase9:46717] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:33,573 DEBUG [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:33,573 INFO [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,37727,1676153013252 with isa=jenkins-hbase9.apache.org/172.31.2.10:46717, startcode=1676153013326 2023-02-11 22:03:33,573 DEBUG [RS:1;jenkins-hbase9:46717] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:33,574 DEBUG [RS:0;jenkins-hbase9:41239] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:41239 2023-02-11 22:03:33,574 INFO [RS:0;jenkins-hbase9:41239] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:33,574 INFO [RS:0;jenkins-hbase9:41239] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:33,574 DEBUG [RS:0;jenkins-hbase9:41239] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:33,575 INFO [RS:0;jenkins-hbase9:41239] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,37727,1676153013252 with isa=jenkins-hbase9.apache.org/172.31.2.10:41239, startcode=1676153013298 2023-02-11 22:03:33,575 DEBUG [RS:0;jenkins-hbase9:41239] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:33,575 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48443, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:33,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:33,578 DEBUG [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518 2023-02-11 22:03:33,578 DEBUG [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39523 2023-02-11 22:03:33,578 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33931, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:33,578 DEBUG [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:33,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:33,579 DEBUG [RS:0;jenkins-hbase9:41239] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518 2023-02-11 22:03:33,579 DEBUG [RS:0;jenkins-hbase9:41239] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39523 2023-02-11 22:03:33,579 DEBUG [RS:0;jenkins-hbase9:41239] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:33,580 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:33,584 DEBUG [RS:1;jenkins-hbase9:46717] zookeeper.ZKUtil(162): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:33,584 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,46717,1676153013326] 2023-02-11 22:03:33,584 WARN [RS:1;jenkins-hbase9:46717] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:33,584 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,41239,1676153013298] 2023-02-11 22:03:33,584 INFO [RS:1;jenkins-hbase9:46717] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:33,584 DEBUG [RS:0;jenkins-hbase9:41239] zookeeper.ZKUtil(162): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:33,584 DEBUG [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/WALs/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:33,584 WARN [RS:0;jenkins-hbase9:41239] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:33,584 INFO [RS:0;jenkins-hbase9:41239] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:33,584 DEBUG [RS:0;jenkins-hbase9:41239] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/WALs/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:33,589 DEBUG [RS:1;jenkins-hbase9:46717] zookeeper.ZKUtil(162): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:33,589 DEBUG [RS:0;jenkins-hbase9:41239] zookeeper.ZKUtil(162): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:33,589 DEBUG [RS:1;jenkins-hbase9:46717] zookeeper.ZKUtil(162): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:33,589 DEBUG [RS:0;jenkins-hbase9:41239] zookeeper.ZKUtil(162): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:33,590 DEBUG [RS:0;jenkins-hbase9:41239] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:33,590 DEBUG [RS:1;jenkins-hbase9:46717] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:33,590 INFO [RS:0;jenkins-hbase9:41239] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:33,590 INFO [RS:1;jenkins-hbase9:46717] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:33,593 INFO [RS:0;jenkins-hbase9:41239] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:33,594 INFO [RS:1;jenkins-hbase9:46717] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:33,594 INFO [RS:0;jenkins-hbase9:41239] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:33,594 INFO [RS:0;jenkins-hbase9:41239] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,594 INFO [RS:1;jenkins-hbase9:46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:33,594 INFO [RS:1;jenkins-hbase9:46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,594 INFO [RS:0;jenkins-hbase9:41239] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:33,595 INFO [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:33,596 INFO [RS:1;jenkins-hbase9:46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,596 INFO [RS:0;jenkins-hbase9:41239] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,596 DEBUG [RS:1;jenkins-hbase9:46717] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:0;jenkins-hbase9:41239] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:1;jenkins-hbase9:46717] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:0;jenkins-hbase9:41239] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:1;jenkins-hbase9:46717] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:0;jenkins-hbase9:41239] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:1;jenkins-hbase9:46717] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:0;jenkins-hbase9:41239] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:1;jenkins-hbase9:46717] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:0;jenkins-hbase9:41239] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:1;jenkins-hbase9:46717] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:33,596 DEBUG [RS:0;jenkins-hbase9:41239] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:33,596 DEBUG [RS:1;jenkins-hbase9:46717] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:0;jenkins-hbase9:41239] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:1;jenkins-hbase9:46717] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:0;jenkins-hbase9:41239] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:1;jenkins-hbase9:46717] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:0;jenkins-hbase9:41239] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:1;jenkins-hbase9:46717] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,596 DEBUG [RS:0;jenkins-hbase9:41239] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:33,609 INFO [RS:1;jenkins-hbase9:46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,610 INFO [RS:1;jenkins-hbase9:46717] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,610 INFO [RS:1;jenkins-hbase9:46717] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,610 INFO [RS:0;jenkins-hbase9:41239] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,610 INFO [RS:0;jenkins-hbase9:41239] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,610 INFO [RS:0;jenkins-hbase9:41239] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,620 INFO [RS:1;jenkins-hbase9:46717] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:33,620 INFO [RS:0;jenkins-hbase9:41239] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:33,620 INFO [RS:1;jenkins-hbase9:46717] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,46717,1676153013326-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,620 INFO [RS:0;jenkins-hbase9:41239] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41239,1676153013298-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,631 INFO [RS:0;jenkins-hbase9:41239] regionserver.Replication(203): jenkins-hbase9.apache.org,41239,1676153013298 started 2023-02-11 22:03:33,631 INFO [RS:0;jenkins-hbase9:41239] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,41239,1676153013298, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:41239, sessionid=0x100456a23e00001 2023-02-11 22:03:33,631 INFO [RS:1;jenkins-hbase9:46717] regionserver.Replication(203): jenkins-hbase9.apache.org,46717,1676153013326 started 2023-02-11 22:03:33,631 DEBUG [RS:0;jenkins-hbase9:41239] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:33,631 DEBUG [RS:0;jenkins-hbase9:41239] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:33,631 INFO [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,46717,1676153013326, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:46717, sessionid=0x100456a23e00002 2023-02-11 22:03:33,631 DEBUG [RS:0;jenkins-hbase9:41239] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41239,1676153013298' 2023-02-11 22:03:33,631 DEBUG [RS:0;jenkins-hbase9:41239] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:33,631 DEBUG [RS:1;jenkins-hbase9:46717] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:33,632 DEBUG [RS:1;jenkins-hbase9:46717] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:33,632 DEBUG [RS:1;jenkins-hbase9:46717] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46717,1676153013326' 2023-02-11 22:03:33,632 DEBUG [RS:1;jenkins-hbase9:46717] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:33,632 DEBUG [RS:1;jenkins-hbase9:46717] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:33,632 DEBUG [RS:0;jenkins-hbase9:41239] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:33,632 DEBUG [RS:1;jenkins-hbase9:46717] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:33,632 DEBUG [RS:0;jenkins-hbase9:41239] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:33,632 DEBUG [RS:0;jenkins-hbase9:41239] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:33,632 DEBUG [RS:1;jenkins-hbase9:46717] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:33,632 DEBUG [RS:0;jenkins-hbase9:41239] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:33,633 DEBUG [RS:0;jenkins-hbase9:41239] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41239,1676153013298' 2023-02-11 22:03:33,632 DEBUG [RS:1;jenkins-hbase9:46717] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:33,633 DEBUG [RS:0;jenkins-hbase9:41239] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:33,633 DEBUG [RS:1;jenkins-hbase9:46717] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46717,1676153013326' 2023-02-11 22:03:33,633 DEBUG [RS:1;jenkins-hbase9:46717] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:33,633 DEBUG [RS:0;jenkins-hbase9:41239] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:33,633 DEBUG [RS:1;jenkins-hbase9:46717] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:33,633 DEBUG [RS:0;jenkins-hbase9:41239] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:33,633 DEBUG [RS:1;jenkins-hbase9:46717] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:33,633 INFO [RS:1;jenkins-hbase9:46717] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:33,633 INFO [RS:1;jenkins-hbase9:46717] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:33,633 INFO [RS:0;jenkins-hbase9:41239] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:33,633 INFO [RS:0;jenkins-hbase9:41239] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:33,673 DEBUG [jenkins-hbase9:37727] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 22:03:33,673 DEBUG [jenkins-hbase9:37727] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:33,675 DEBUG [jenkins-hbase9:37727] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:33,675 DEBUG [jenkins-hbase9:37727] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:33,675 DEBUG [jenkins-hbase9:37727] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:33,676 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,46717,1676153013326, state=OPENING 2023-02-11 22:03:33,679 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 22:03:33,681 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:33,682 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:33,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,46717,1676153013326}] 2023-02-11 22:03:33,836 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:33,836 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 22:03:33,838 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53170, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 22:03:33,842 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 22:03:33,842 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:33,843 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C46717%2C1676153013326.meta, suffix=.meta, logDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/WALs/jenkins-hbase9.apache.org,46717,1676153013326, archiveDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/oldWALs, maxLogs=32 2023-02-11 22:03:33,858 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37425,DS-4f3f9452-d4cd-4668-8395-2be933214297,DISK] 2023-02-11 22:03:33,858 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40115,DS-0e7a6d41-8b0f-41f4-95b9-25d2ebf0ea09,DISK] 2023-02-11 22:03:33,860 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/WALs/jenkins-hbase9.apache.org,46717,1676153013326/jenkins-hbase9.apache.org%2C46717%2C1676153013326.meta.1676153013844.meta 2023-02-11 22:03:33,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37425,DS-4f3f9452-d4cd-4668-8395-2be933214297,DISK], DatanodeInfoWithStorage[127.0.0.1:40115,DS-0e7a6d41-8b0f-41f4-95b9-25d2ebf0ea09,DISK]] 2023-02-11 22:03:33,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:33,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 22:03:33,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 22:03:33,860 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 22:03:33,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 22:03:33,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:33,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 22:03:33,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 22:03:33,862 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:33,863 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/info 2023-02-11 22:03:33,863 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/info 2023-02-11 22:03:33,863 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:33,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:33,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:33,865 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:33,865 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:33,865 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:33,866 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:33,866 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:33,867 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/table 2023-02-11 22:03:33,867 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/table 2023-02-11 22:03:33,867 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:33,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:33,868 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740 2023-02-11 22:03:33,869 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740 2023-02-11 22:03:33,871 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:33,872 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:33,873 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63811336, jitterRate=-0.049136996269226074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:33,873 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676153013861Writing region info on filesystem at 1676153013861Initializing all the Stores at 1676153013862 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153013862Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153013862Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153013862Cleaning up temporary data from old regions at 1676153013870 (+8 ms)Cleaning up detritus from prior splits at 1676153013870Running coprocessor post-open hooks at 1676153013873 (+3 ms)Region opened successfully at 1676153013873 2023-02-11 22:03:33,873 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676153013836 2023-02-11 22:03:33,878 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 22:03:33,878 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 22:03:33,878 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,46717,1676153013326, state=OPEN 2023-02-11 22:03:33,880 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 22:03:33,880 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:33,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 22:03:33,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,46717,1676153013326 in 198 msec 2023-02-11 22:03:33,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 22:03:33,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-02-11 22:03:33,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 402 msec 2023-02-11 22:03:33,885 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676153013352, completionTime=-1 2023-02-11 22:03:33,885 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 22:03:33,885 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 22:03:33,894 DEBUG [hconnection-0x7bf8f2eb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:33,896 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53172, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:33,897 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 22:03:33,897 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676153073897 2023-02-11 22:03:33,897 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676153133897 2023-02-11 22:03:33,897 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 12 msec 2023-02-11 22:03:33,905 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37727,1676153013252-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,905 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37727,1676153013252-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,905 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37727,1676153013252-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,905 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:37727, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,905 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:33,906 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 22:03:33,906 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:33,906 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 22:03:33,908 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 22:03:33,908 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:33,909 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:33,910 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3 2023-02-11 22:03:33,910 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3 empty. 2023-02-11 22:03:33,911 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3 2023-02-11 22:03:33,911 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 22:03:33,922 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:33,923 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 95672bafbb80c28b244f85f3b3b4e9d3, NAME => 'hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp 2023-02-11 22:03:33,933 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:33,933 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 95672bafbb80c28b244f85f3b3b4e9d3, disabling compactions & flushes 2023-02-11 22:03:33,933 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. 2023-02-11 22:03:33,933 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. 2023-02-11 22:03:33,933 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. after waiting 0 ms 2023-02-11 22:03:33,933 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. 2023-02-11 22:03:33,933 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. 2023-02-11 22:03:33,933 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 95672bafbb80c28b244f85f3b3b4e9d3: Waiting for close lock at 1676153013933Disabling compacts and flushes for region at 1676153013933Disabling writes for close at 1676153013933Writing region close event to WAL at 1676153013933Closed at 1676153013933 2023-02-11 22:03:33,935 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:33,936 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153013936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153013936"}]},"ts":"1676153013936"} 2023-02-11 22:03:33,938 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 22:03:33,938 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:33,939 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153013938"}]},"ts":"1676153013938"} 2023-02-11 22:03:33,940 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 22:03:33,943 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:33,944 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:33,944 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:33,944 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:33,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=95672bafbb80c28b244f85f3b3b4e9d3, ASSIGN}] 2023-02-11 22:03:33,946 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=95672bafbb80c28b244f85f3b3b4e9d3, ASSIGN 2023-02-11 22:03:33,947 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=95672bafbb80c28b244f85f3b3b4e9d3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46717,1676153013326; forceNewPlan=false, retain=false 2023-02-11 22:03:34,097 INFO [jenkins-hbase9:37727] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 22:03:34,098 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=95672bafbb80c28b244f85f3b3b4e9d3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:34,099 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153014098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153014098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153014098"}]},"ts":"1676153014098"} 2023-02-11 22:03:34,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 95672bafbb80c28b244f85f3b3b4e9d3, server=jenkins-hbase9.apache.org,46717,1676153013326}] 2023-02-11 22:03:34,256 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. 2023-02-11 22:03:34,257 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C46717%2C1676153013326, suffix=, logDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/WALs/jenkins-hbase9.apache.org,46717,1676153013326, archiveDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/oldWALs, maxLogs=32 2023-02-11 22:03:34,271 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40115,DS-0e7a6d41-8b0f-41f4-95b9-25d2ebf0ea09,DISK] 2023-02-11 22:03:34,271 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37425,DS-4f3f9452-d4cd-4668-8395-2be933214297,DISK] 2023-02-11 22:03:34,273 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/WALs/jenkins-hbase9.apache.org,46717,1676153013326/jenkins-hbase9.apache.org%2C46717%2C1676153013326.1676153014258 2023-02-11 22:03:34,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40115,DS-0e7a6d41-8b0f-41f4-95b9-25d2ebf0ea09,DISK], DatanodeInfoWithStorage[127.0.0.1:37425,DS-4f3f9452-d4cd-4668-8395-2be933214297,DISK]] 2023-02-11 22:03:34,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 95672bafbb80c28b244f85f3b3b4e9d3, NAME => 'hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:34,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 95672bafbb80c28b244f85f3b3b4e9d3 2023-02-11 22:03:34,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:34,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 95672bafbb80c28b244f85f3b3b4e9d3 2023-02-11 22:03:34,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 95672bafbb80c28b244f85f3b3b4e9d3 2023-02-11 22:03:34,276 INFO [StoreOpener-95672bafbb80c28b244f85f3b3b4e9d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 95672bafbb80c28b244f85f3b3b4e9d3 2023-02-11 22:03:34,278 DEBUG [StoreOpener-95672bafbb80c28b244f85f3b3b4e9d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3/info 2023-02-11 22:03:34,278 DEBUG [StoreOpener-95672bafbb80c28b244f85f3b3b4e9d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3/info 2023-02-11 22:03:34,278 INFO [StoreOpener-95672bafbb80c28b244f85f3b3b4e9d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95672bafbb80c28b244f85f3b3b4e9d3 columnFamilyName info 2023-02-11 22:03:34,279 INFO [StoreOpener-95672bafbb80c28b244f85f3b3b4e9d3-1] regionserver.HStore(310): Store=95672bafbb80c28b244f85f3b3b4e9d3/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:34,280 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3 2023-02-11 22:03:34,280 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3 2023-02-11 22:03:34,288 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 95672bafbb80c28b244f85f3b3b4e9d3 2023-02-11 22:03:34,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:34,292 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 95672bafbb80c28b244f85f3b3b4e9d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73595567, jitterRate=0.09665940701961517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:34,292 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 95672bafbb80c28b244f85f3b3b4e9d3: Running coprocessor pre-open hook at 1676153014274Writing region info on filesystem at 1676153014274Initializing all the Stores at 1676153014275 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153014275Cleaning up temporary data from old regions at 1676153014280 (+5 ms)Cleaning up detritus from prior splits at 1676153014286 (+6 ms)Running coprocessor post-open hooks at 1676153014292 (+6 ms)Region opened successfully at 1676153014292 2023-02-11 22:03:34,303 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3., pid=6, masterSystemTime=1676153014252 2023-02-11 22:03:34,306 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. 2023-02-11 22:03:34,306 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. 2023-02-11 22:03:34,306 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=95672bafbb80c28b244f85f3b3b4e9d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:34,306 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153014306"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153014306"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153014306"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153014306"}]},"ts":"1676153014306"} 2023-02-11 22:03:34,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 22:03:34,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 95672bafbb80c28b244f85f3b3b4e9d3, server=jenkins-hbase9.apache.org,46717,1676153013326 in 208 msec 2023-02-11 22:03:34,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 22:03:34,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=95672bafbb80c28b244f85f3b3b4e9d3, ASSIGN in 366 msec 2023-02-11 22:03:34,325 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:34,325 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153014325"}]},"ts":"1676153014325"} 2023-02-11 22:03:34,341 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 22:03:34,344 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:34,345 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 438 msec 2023-02-11 22:03:34,408 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 22:03:34,409 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:34,409 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:34,414 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 22:03:34,422 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:34,425 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-11 22:03:34,435 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 22:03:34,442 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:34,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-11 22:03:34,451 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 22:03:34,453 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 22:03:34,453 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.096sec 2023-02-11 22:03:34,453 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 22:03:34,453 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 22:03:34,453 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 22:03:34,453 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37727,1676153013252-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 22:03:34,453 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37727,1676153013252-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 22:03:34,455 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 22:03:34,552 DEBUG [Listener at localhost/42889] zookeeper.ReadOnlyZKClient(139): Connect 0x2b97b7f0 to 127.0.0.1:62800 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:34,558 DEBUG [Listener at localhost/42889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@162e11e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:34,560 DEBUG [hconnection-0x10c07e2e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:34,561 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53186, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:34,563 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,37727,1676153013252 2023-02-11 22:03:34,563 DEBUG [Listener at localhost/42889] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 22:03:34,565 DEBUG [Listener at localhost/42889] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 22:03:34,567 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50042, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 22:03:34,567 INFO [Listener at localhost/42889] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:34,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:34,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 22:03:34,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.2.10:50042 deadline: 1676153074567, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:34,568 INFO [Listener at localhost/42889] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-11 22:03:34,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:34,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:34,573 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:34,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-11 22:03:34,574 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:34,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:34,576 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:34,576 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990 empty. 2023-02-11 22:03:34,577 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:34,577 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-11 22:03:34,586 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:34,587 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => aa96b9a912ca31c00b310c9fe0da2990, NAME => 'testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp 2023-02-11 22:03:34,594 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:34,594 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing aa96b9a912ca31c00b310c9fe0da2990, disabling compactions & flushes 2023-02-11 22:03:34,594 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:34,594 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:34,594 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. after waiting 0 ms 2023-02-11 22:03:34,594 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:34,594 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:34,594 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for aa96b9a912ca31c00b310c9fe0da2990: Waiting for close lock at 1676153014594Disabling compacts and flushes for region at 1676153014594Disabling writes for close at 1676153014594Writing region close event to WAL at 1676153014594Closed at 1676153014594 2023-02-11 22:03:34,596 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:34,597 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676153014597"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153014597"}]},"ts":"1676153014597"} 2023-02-11 22:03:34,598 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 22:03:34,599 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:34,599 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153014599"}]},"ts":"1676153014599"} 2023-02-11 22:03:34,600 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-11 22:03:34,603 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:34,604 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:34,604 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:34,604 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:34,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa96b9a912ca31c00b310c9fe0da2990, ASSIGN}] 2023-02-11 22:03:34,605 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa96b9a912ca31c00b310c9fe0da2990, ASSIGN 2023-02-11 22:03:34,606 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa96b9a912ca31c00b310c9fe0da2990, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46717,1676153013326; forceNewPlan=false, retain=false 2023-02-11 22:03:34,635 INFO [RS:0;jenkins-hbase9:41239] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41239%2C1676153013298, suffix=, logDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/WALs/jenkins-hbase9.apache.org,41239,1676153013298, archiveDir=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/oldWALs, maxLogs=32 2023-02-11 22:03:34,650 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37425,DS-4f3f9452-d4cd-4668-8395-2be933214297,DISK] 2023-02-11 22:03:34,650 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40115,DS-0e7a6d41-8b0f-41f4-95b9-25d2ebf0ea09,DISK] 2023-02-11 22:03:34,652 INFO [RS:0;jenkins-hbase9:41239] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/WALs/jenkins-hbase9.apache.org,41239,1676153013298/jenkins-hbase9.apache.org%2C41239%2C1676153013298.1676153014636 2023-02-11 22:03:34,652 DEBUG [RS:0;jenkins-hbase9:41239] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40115,DS-0e7a6d41-8b0f-41f4-95b9-25d2ebf0ea09,DISK], DatanodeInfoWithStorage[127.0.0.1:37425,DS-4f3f9452-d4cd-4668-8395-2be933214297,DISK]] 2023-02-11 22:03:34,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:34,756 INFO [jenkins-hbase9:37727] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 22:03:34,757 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aa96b9a912ca31c00b310c9fe0da2990, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:34,758 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676153014757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153014757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153014757"}]},"ts":"1676153014757"} 2023-02-11 22:03:34,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure aa96b9a912ca31c00b310c9fe0da2990, server=jenkins-hbase9.apache.org,46717,1676153013326}] 2023-02-11 22:03:34,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:34,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:34,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aa96b9a912ca31c00b310c9fe0da2990, NAME => 'testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:34,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:34,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:34,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:34,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:34,916 INFO [StoreOpener-aa96b9a912ca31c00b310c9fe0da2990-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:34,918 DEBUG [StoreOpener-aa96b9a912ca31c00b310c9fe0da2990-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1 2023-02-11 22:03:34,918 DEBUG [StoreOpener-aa96b9a912ca31c00b310c9fe0da2990-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1 2023-02-11 22:03:34,918 INFO [StoreOpener-aa96b9a912ca31c00b310c9fe0da2990-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa96b9a912ca31c00b310c9fe0da2990 columnFamilyName f1 2023-02-11 22:03:34,918 INFO [StoreOpener-aa96b9a912ca31c00b310c9fe0da2990-1] regionserver.HStore(310): Store=aa96b9a912ca31c00b310c9fe0da2990/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:34,919 INFO [StoreOpener-aa96b9a912ca31c00b310c9fe0da2990-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:34,920 DEBUG [StoreOpener-aa96b9a912ca31c00b310c9fe0da2990-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2 2023-02-11 22:03:34,920 DEBUG [StoreOpener-aa96b9a912ca31c00b310c9fe0da2990-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2 2023-02-11 22:03:34,920 INFO [StoreOpener-aa96b9a912ca31c00b310c9fe0da2990-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa96b9a912ca31c00b310c9fe0da2990 columnFamilyName f2 2023-02-11 22:03:34,921 INFO [StoreOpener-aa96b9a912ca31c00b310c9fe0da2990-1] regionserver.HStore(310): Store=aa96b9a912ca31c00b310c9fe0da2990/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:34,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:34,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:34,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:34,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:34,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:34,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened aa96b9a912ca31c00b310c9fe0da2990; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65004112, jitterRate=-0.03136324882507324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:34,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for aa96b9a912ca31c00b310c9fe0da2990: Running coprocessor pre-open hook at 1676153014915Writing region info on filesystem at 1676153014915Initializing all the Stores at 1676153014916 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153014916Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153014916Cleaning up temporary data from old regions at 1676153014922 (+6 ms)Cleaning up detritus from prior splits at 1676153014922Running coprocessor post-open hooks at 1676153014926 (+4 ms)Region opened successfully at 1676153014926 2023-02-11 22:03:34,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990., pid=12, masterSystemTime=1676153014911 2023-02-11 22:03:34,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:34,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:34,929 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aa96b9a912ca31c00b310c9fe0da2990, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:34,929 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676153014929"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153014929"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153014929"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153014929"}]},"ts":"1676153014929"} 2023-02-11 22:03:34,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-11 22:03:34,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure aa96b9a912ca31c00b310c9fe0da2990, server=jenkins-hbase9.apache.org,46717,1676153013326 in 171 msec 2023-02-11 22:03:34,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 22:03:34,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa96b9a912ca31c00b310c9fe0da2990, ASSIGN in 328 msec 2023-02-11 22:03:34,934 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:34,934 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153014934"}]},"ts":"1676153014934"} 2023-02-11 22:03:34,935 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-11 22:03:34,937 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:34,938 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 366 msec 2023-02-11 22:03:35,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:35,180 INFO [Listener at localhost/42889] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-11 22:03:35,180 DEBUG [Listener at localhost/42889] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-11 22:03:35,180 INFO [Listener at localhost/42889] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:35,182 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-11 22:03:35,182 INFO [Listener at localhost/42889] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:35,182 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-11 22:03:35,182 INFO [Listener at localhost/42889] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 22:03:35,217 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46717] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:35,325 INFO [Listener at localhost/42889] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 22:03:35,325 INFO [Listener at localhost/42889] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 22:03:35,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-11 22:03:35,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676153015327 (current time:1676153015327). 2023-02-11 22:03:35,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 22:03:35,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] zookeeper.ReadOnlyZKClient(139): Connect 0x39aecf41 to 127.0.0.1:62800 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:35,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e628df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:35,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:35,336 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53202, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:35,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39aecf41 to 127.0.0.1:62800 2023-02-11 22:03:35,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:35,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 22:03:35,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-11 22:03:35,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-11 22:03:35,340 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-11 22:03:35,341 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676153615341 2023-02-11 22:03:35,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-11 22:03:35,341 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,342 DEBUG [Listener at localhost/42889] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:35,342 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-11 22:03:35,342 DEBUG [Listener at localhost/42889] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 22:03:35,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-11 22:03:35,343 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-11 22:03:35,344 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-11 22:03:35,344 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676153615344 2023-02-11 22:03:35,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-11 22:03:35,357 INFO [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-11 22:03:35,357 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:35,358 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-11 22:03:35,358 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-11 22:03:35,358 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,358 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-11 22:03:35,359 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:35,359 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:35,359 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:35,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:35,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:35,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:35,360 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,360 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:35,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-11 22:03:35,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-11 22:03:35,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-11 22:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-11 22:03:35,361 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-11 22:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-11 22:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-11 22:03:35,361 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-11 22:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-11 22:03:35,361 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-11 22:03:35,367 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-11 22:03:35,367 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:35,367 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-11 22:03:35,368 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-11 22:03:35,368 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-11 22:03:35,368 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:35,368 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46717,1676153013326' joining acquired barrier for procedure (foo) in zk 2023-02-11 22:03:35,368 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-11 22:03:35,368 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-11 22:03:35,368 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41239,1676153013298' joining acquired barrier for procedure (foo) in zk 2023-02-11 22:03:35,369 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,372 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,372 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:35,372 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,372 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:35,372 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,372 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 22:03:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:35,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46717,1676153013326' joining acquired barrier for procedure 'foo' on coordinator 2023-02-11 22:03:35,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48fa0e5[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:35,375 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-11 22:03:35,375 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,376 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,377 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-11 22:03:35,377 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,377 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:35,382 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-11 22:03:35,382 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 22:03:35,382 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:35,382 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. started... 2023-02-11 22:03:35,383 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,383 INFO [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] regionserver.HRegion(2744): Flushing aa96b9a912ca31c00b310c9fe0da2990 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-11 22:03:35,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,383 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-11 22:03:35,383 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-11 22:03:35,383 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase9.apache.org,41239,1676153013298' in zk 2023-02-11 22:03:35,385 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-11 22:03:35,385 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:35,385 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-11 22:03:35,400 INFO [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/.tmp/f1/2635525fef4b4ed08024aeeded6db693 2023-02-11 22:03:35,424 INFO [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/.tmp/f2/829ecd148231465f98d8489ccbad9aeb 2023-02-11 22:03:35,429 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/.tmp/f1/2635525fef4b4ed08024aeeded6db693 as hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1/2635525fef4b4ed08024aeeded6db693 2023-02-11 22:03:35,433 INFO [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1/2635525fef4b4ed08024aeeded6db693, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 22:03:35,434 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/.tmp/f2/829ecd148231465f98d8489ccbad9aeb as hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2/829ecd148231465f98d8489ccbad9aeb 2023-02-11 22:03:35,438 INFO [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2/829ecd148231465f98d8489ccbad9aeb, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 22:03:35,439 INFO [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for aa96b9a912ca31c00b310c9fe0da2990 in 56ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:35,439 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-11 22:03:35,441 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for aa96b9a912ca31c00b310c9fe0da2990: 2023-02-11 22:03:35,441 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.' region-info for snapshot=foo 2023-02-11 22:03:35,441 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:35,441 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1/2635525fef4b4ed08024aeeded6db693] hfiles 2023-02-11 22:03:35,441 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1/2635525fef4b4ed08024aeeded6db693 for snapshot=foo 2023-02-11 22:03:35,441 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2/829ecd148231465f98d8489ccbad9aeb] hfiles 2023-02-11 22:03:35,441 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2/829ecd148231465f98d8489ccbad9aeb for snapshot=foo 2023-02-11 22:03:35,443 DEBUG [Listener at localhost/42889] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:35,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-11 22:03:35,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:35,444 DEBUG [Listener at localhost/42889] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 22:03:35,450 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. completed. 2023-02-11 22:03:35,450 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:35,450 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-11 22:03:35,450 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-11 22:03:35,450 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,450 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-11 22:03:35,450 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase9.apache.org,46717,1676153013326' in zk 2023-02-11 22:03:35,452 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-11 22:03:35,452 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,452 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:35,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:35,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:35,452 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-11 22:03:35,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:35,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:35,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 22:03:35,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:35,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 22:03:35,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase9.apache.org,46717,1676153013326': 2023-02-11 22:03:35,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46717,1676153013326' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-11 22:03:35,457 INFO [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-11 22:03:35,457 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:35,457 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:35,457 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-11 22:03:35,457 INFO [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 22:03:35,459 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,459 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,459 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:35,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,459 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:35,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:35,459 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:35,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:35,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:35,460 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:35,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:35,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:35,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,460 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 22:03:35,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 22:03:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,462 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,462 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:35,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 22:03:35,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,471 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,471 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:35,471 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:35,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:35,471 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-11 22:03:35,471 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:35,471 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:35,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:35,471 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:35,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-11 22:03:35,471 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:35,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:35,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-11 22:03:35,473 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-11 22:03:35,473 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,473 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,473 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:35,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:35,473 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 22:03:35,473 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 22:03:35,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.hbase-snapshot/.tmp/foo 2023-02-11 22:03:35,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.hbase-snapshot/.tmp/foo to hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.hbase-snapshot/foo 2023-02-11 22:03:35,503 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-11 22:03:35,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.hbase-snapshot/.tmp/foo 2023-02-11 22:03:35,504 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.hbase-snapshot/.tmp/foo 2023-02-11 22:03:35,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676153015341Consolidate snapshot: foo at 1676153015473 (+132 ms)Loading Region manifests for foo at 1676153015473Writing data manifest for foo at 1676153015476 (+3 ms)Verifying snapshot: foo at 1676153015482 (+6 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676153015503 (+21 ms) 2023-02-11 22:03:35,505 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-11 22:03:35,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 163 msec 2023-02-11 22:03:35,645 DEBUG [Listener at localhost/42889] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:35,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-11 22:03:35,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 22:03:35,646 INFO [Listener at localhost/42889] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 22:03:35,651 INFO [Listener at localhost/42889] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 22:03:35,656 INFO [Listener at localhost/42889] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 22:03:35,699 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46717] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:35,793 INFO [Listener at localhost/42889] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 22:03:35,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-11 22:03:35,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,803 INFO [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-11 22:03:35,803 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:35,804 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-11 22:03:35,804 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-11 22:03:35,804 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,804 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,806 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,806 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:35,806 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:35,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:35,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:35,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:35,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:35,806 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,806 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:35,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:35,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,807 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,808 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,808 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-11 22:03:35,808 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:35,808 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-11 22:03:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,809 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 22:03:35,809 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 22:03:35,809 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:35,809 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. started... 2023-02-11 22:03:35,809 INFO [rs(jenkins-hbase9.apache.org,46717,1676153013326)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aa96b9a912ca31c00b310c9fe0da2990 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-11 22:03:35,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,810 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,813 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-11 22:03:35,813 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:35,814 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-11 22:03:35,814 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-11 22:03:35,814 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41239,1676153013298' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-11 22:03:35,817 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,818 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,818 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:35,827 INFO [rs(jenkins-hbase9.apache.org,46717,1676153013326)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/.tmp/f1/3569e08405aa464593e2608ec3805bc3 2023-02-11 22:03:35,846 INFO [rs(jenkins-hbase9.apache.org,46717,1676153013326)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/.tmp/f2/b451a4ff39864518aa51650f5a15870e 2023-02-11 22:03:35,850 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/.tmp/f1/3569e08405aa464593e2608ec3805bc3 as hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1/3569e08405aa464593e2608ec3805bc3 2023-02-11 22:03:35,855 INFO [rs(jenkins-hbase9.apache.org,46717,1676153013326)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1/3569e08405aa464593e2608ec3805bc3, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 22:03:35,856 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/.tmp/f2/b451a4ff39864518aa51650f5a15870e as hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2/b451a4ff39864518aa51650f5a15870e 2023-02-11 22:03:35,860 INFO [rs(jenkins-hbase9.apache.org,46717,1676153013326)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2/b451a4ff39864518aa51650f5a15870e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 22:03:35,861 INFO [rs(jenkins-hbase9.apache.org,46717,1676153013326)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for aa96b9a912ca31c00b310c9fe0da2990 in 52ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:35,862 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aa96b9a912ca31c00b310c9fe0da2990: 2023-02-11 22:03:35,862 DEBUG [rs(jenkins-hbase9.apache.org,46717,1676153013326)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:35,862 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 22:03:35,862 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 22:03:35,862 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,862 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-11 22:03:35,862 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46717,1676153013326' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-11 22:03:35,864 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,864 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:35,864 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:35,864 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:35,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46717,1676153013326' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-11 22:03:35,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b024ac[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:35,866 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-11 22:03:35,866 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,867 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,867 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,868 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-11 22:03:35,868 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-11 22:03:35,868 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-11 22:03:35,868 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,868 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:35,868 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase9.apache.org,41239,1676153013298' in zk 2023-02-11 22:03:35,868 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-11 22:03:35,868 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase9.apache.org,46717,1676153013326' in zk 2023-02-11 22:03:35,869 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-11 22:03:35,869 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:35,869 DEBUG [member: 'jenkins-hbase9.apache.org,41239,1676153013298' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-11 22:03:35,870 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,870 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-11 22:03:35,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:35,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:35,871 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:35,871 DEBUG [member: 'jenkins-hbase9.apache.org,46717,1676153013326' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-11 22:03:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:35,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase9.apache.org,46717,1676153013326': 2023-02-11 22:03:35,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46717,1676153013326' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-11 22:03:35,876 INFO [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-11 22:03:35,876 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:35,876 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:35,876 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,876 INFO [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 22:03:35,878 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,878 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,878 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:35,878 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:35,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,878 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,879 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:35,879 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,881 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:35,881 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,884 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:35,884 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:35,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:35,884 DEBUG [(jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:35,884 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:35,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-11 22:03:35,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 22:03:35,884 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,884 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:35,885 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:35,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:35,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:35,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:35,885 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:35,885 DEBUG [Listener at localhost/42889] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:35,885 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,885 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:35,885 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:35,885 DEBUG [Listener at localhost/42889] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 22:03:35,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:35,885 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:35,886 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,886 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,986 DEBUG [Listener at localhost/42889] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 22:03:35,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 22:03:35,992 INFO [Listener at localhost/42889] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676153015327 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:35,992 DEBUG [Listener at localhost/42889] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39523/user/jenkins/test-data/cfd0cd69-6344-0ad2-5bf6-df0a8433c040/foo/a87b6631-2308-4def-836a-51b1a6557535/data/default/testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:35,992 INFO [Listener at localhost/42889] snapshot.RestoreSnapshotHelper(239): region to add: aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:35,992 INFO [Listener at localhost/42889] snapshot.RestoreSnapshotHelper(585): clone region=aa96b9a912ca31c00b310c9fe0da2990 as aa96b9a912ca31c00b310c9fe0da2990 in snapshot foo 2023-02-11 22:03:35,993 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => aa96b9a912ca31c00b310c9fe0da2990, NAME => 'testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39523/user/jenkins/test-data/cfd0cd69-6344-0ad2-5bf6-df0a8433c040/foo/a87b6631-2308-4def-836a-51b1a6557535 2023-02-11 22:03:36,003 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:36,003 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2635525fef4b4ed08024aeeded6db693 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:36,005 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 829ecd148231465f98d8489ccbad9aeb from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:36,010 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing aa96b9a912ca31c00b310c9fe0da2990, disabling compactions & flushes 2023-02-11 22:03:36,010 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:36,010 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:36,010 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. after waiting 0 ms 2023-02-11 22:03:36,010 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:36,010 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:36,010 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for aa96b9a912ca31c00b310c9fe0da2990: Waiting for close lock at 1676153016010Disabling compacts and flushes for region at 1676153016010Disabling writes for close at 1676153016010Writing region close event to WAL at 1676153016010Closed at 1676153016010 2023-02-11 22:03:36,010 INFO [Listener at localhost/42889] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676153015327 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:36,010 DEBUG [Listener at localhost/42889] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39523/user/jenkins/test-data/cfd0cd69-6344-0ad2-5bf6-df0a8433c040/foo/a87b6631-2308-4def-836a-51b1a6557535 2023-02-11 22:03:36,010 DEBUG [Listener at localhost/42889] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39523/user/jenkins/test-data/cfd0cd69-6344-0ad2-5bf6-df0a8433c040/foo/a87b6631-2308-4def-836a-51b1a6557535 2023-02-11 22:03:36,011 DEBUG [Listener at localhost/42889] util.CommonFSUtils(699): |-data/ 2023-02-11 22:03:36,011 DEBUG [Listener at localhost/42889] util.CommonFSUtils(699): |----default/ 2023-02-11 22:03:36,011 DEBUG [Listener at localhost/42889] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-11 22:03:36,012 DEBUG [Listener at localhost/42889] util.CommonFSUtils(699): |----------aa96b9a912ca31c00b310c9fe0da2990/ 2023-02-11 22:03:36,012 DEBUG [Listener at localhost/42889] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:36,012 DEBUG [Listener at localhost/42889] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:36,012 DEBUG [Listener at localhost/42889] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=aa96b9a912ca31c00b310c9fe0da2990-2635525fef4b4ed08024aeeded6db693 2023-02-11 22:03:36,012 DEBUG [Listener at localhost/42889] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:36,013 DEBUG [Listener at localhost/42889] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=aa96b9a912ca31c00b310c9fe0da2990-829ecd148231465f98d8489ccbad9aeb 2023-02-11 22:03:36,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "foo" 2023-02-11 22:03:36,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-11 22:03:36,017 INFO [Listener at localhost/42889] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:36,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:36,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:36,021 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153016021"}]},"ts":"1676153016021"} 2023-02-11 22:03:36,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 22:03:36,022 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-11 22:03:36,024 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-11 22:03:36,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa96b9a912ca31c00b310c9fe0da2990, UNASSIGN}] 2023-02-11 22:03:36,025 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa96b9a912ca31c00b310c9fe0da2990, UNASSIGN 2023-02-11 22:03:36,026 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=aa96b9a912ca31c00b310c9fe0da2990, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:36,026 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676153016026"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153016026"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153016026"}]},"ts":"1676153016026"} 2023-02-11 22:03:36,027 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure aa96b9a912ca31c00b310c9fe0da2990, server=jenkins-hbase9.apache.org,46717,1676153013326}] 2023-02-11 22:03:36,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 22:03:36,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:36,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing aa96b9a912ca31c00b310c9fe0da2990, disabling compactions & flushes 2023-02-11 22:03:36,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:36,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:36,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. after waiting 0 ms 2023-02-11 22:03:36,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:36,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:36,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990. 2023-02-11 22:03:36,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for aa96b9a912ca31c00b310c9fe0da2990: Waiting for close lock at 1676153016179Running coprocessor pre-close hooks at 1676153016179Disabling compacts and flushes for region at 1676153016179Disabling writes for close at 1676153016180 (+1 ms)Writing region close event to WAL at 1676153016180Running coprocessor post-close hooks at 1676153016184 (+4 ms)Closed at 1676153016184 2023-02-11 22:03:36,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:36,186 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=aa96b9a912ca31c00b310c9fe0da2990, regionState=CLOSED 2023-02-11 22:03:36,186 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676153016186"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153016186"}]},"ts":"1676153016186"} 2023-02-11 22:03:36,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-11 22:03:36,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure aa96b9a912ca31c00b310c9fe0da2990, server=jenkins-hbase9.apache.org,46717,1676153013326 in 161 msec 2023-02-11 22:03:36,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 22:03:36,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa96b9a912ca31c00b310c9fe0da2990, UNASSIGN in 165 msec 2023-02-11 22:03:36,191 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153016191"}]},"ts":"1676153016191"} 2023-02-11 22:03:36,192 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-11 22:03:36,196 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-11 22:03:36,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 179 msec 2023-02-11 22:03:36,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 22:03:36,324 INFO [Listener at localhost/42889] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-11 22:03:36,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:36,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:36,328 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:36,328 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:36,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 22:03:36,331 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:36,333 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1, FileablePath, hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2, FileablePath, hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/recovered.edits] 2023-02-11 22:03:36,336 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1/2635525fef4b4ed08024aeeded6db693 to hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/archive/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1/2635525fef4b4ed08024aeeded6db693 2023-02-11 22:03:36,337 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1/3569e08405aa464593e2608ec3805bc3 to hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/archive/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f1/3569e08405aa464593e2608ec3805bc3 2023-02-11 22:03:36,340 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2/829ecd148231465f98d8489ccbad9aeb to hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/archive/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2/829ecd148231465f98d8489ccbad9aeb 2023-02-11 22:03:36,342 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2/b451a4ff39864518aa51650f5a15870e to hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/archive/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/f2/b451a4ff39864518aa51650f5a15870e 2023-02-11 22:03:36,345 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/recovered.edits/12.seqid to hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/archive/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990/recovered.edits/12.seqid 2023-02-11 22:03:36,345 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa96b9a912ca31c00b310c9fe0da2990 2023-02-11 22:03:36,345 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-11 22:03:36,347 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:36,349 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-11 22:03:36,351 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-11 22:03:36,352 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:36,352 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-11 22:03:36,352 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153016352"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:36,354 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 22:03:36,354 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => aa96b9a912ca31c00b310c9fe0da2990, NAME => 'testInitTableSnapshotMapperJobConfig,,1676153014570.aa96b9a912ca31c00b310c9fe0da2990.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 22:03:36,354 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-11 22:03:36,354 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676153016354"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:36,358 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-11 22:03:36,360 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 22:03:36,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 35 msec 2023-02-11 22:03:36,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37727] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 22:03:36,430 INFO [Listener at localhost/42889] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-11 22:03:36,430 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 22:03:36,430 INFO [Listener at localhost/42889] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 22:03:36,431 DEBUG [Listener at localhost/42889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b97b7f0 to 127.0.0.1:62800 2023-02-11 22:03:36,431 DEBUG [Listener at localhost/42889] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:36,431 DEBUG [Listener at localhost/42889] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 22:03:36,431 DEBUG [Listener at localhost/42889] util.JVMClusterUtil(257): Found active master hash=1449053844, stopped=false 2023-02-11 22:03:36,431 INFO [Listener at localhost/42889] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,37727,1676153013252 2023-02-11 22:03:36,433 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:36,433 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:36,433 INFO [Listener at localhost/42889] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 22:03:36,433 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:36,433 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:36,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:36,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:36,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:36,436 DEBUG [Listener at localhost/42889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fd66f6c to 127.0.0.1:62800 2023-02-11 22:03:36,436 DEBUG [Listener at localhost/42889] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:36,436 INFO [Listener at localhost/42889] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,41239,1676153013298' ***** 2023-02-11 22:03:36,436 INFO [Listener at localhost/42889] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:36,437 INFO [Listener at localhost/42889] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,46717,1676153013326' ***** 2023-02-11 22:03:36,437 INFO [Listener at localhost/42889] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:36,437 INFO [RS:1;jenkins-hbase9:46717] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:36,437 INFO [RS:1;jenkins-hbase9:46717] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:36,437 INFO [RS:1;jenkins-hbase9:46717] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:36,437 INFO [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(3304): Received CLOSE for 95672bafbb80c28b244f85f3b3b4e9d3 2023-02-11 22:03:36,437 INFO [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:36,437 DEBUG [RS:1;jenkins-hbase9:46717] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06ef2268 to 127.0.0.1:62800 2023-02-11 22:03:36,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 95672bafbb80c28b244f85f3b3b4e9d3, disabling compactions & flushes 2023-02-11 22:03:36,437 INFO [RS:0;jenkins-hbase9:41239] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:36,438 INFO [RS:0;jenkins-hbase9:41239] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:36,439 INFO [RS:0;jenkins-hbase9:41239] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:36,439 INFO [RS:0;jenkins-hbase9:41239] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:36,439 DEBUG [RS:0;jenkins-hbase9:41239] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f80988c to 127.0.0.1:62800 2023-02-11 22:03:36,439 DEBUG [RS:0;jenkins-hbase9:41239] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:36,439 INFO [RS:0;jenkins-hbase9:41239] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,41239,1676153013298; all regions closed. 2023-02-11 22:03:36,438 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:36,438 DEBUG [RS:1;jenkins-hbase9:46717] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:36,438 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:36,439 INFO [RS:1;jenkins-hbase9:46717] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:36,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. 2023-02-11 22:03:36,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. 2023-02-11 22:03:36,439 INFO [RS:1;jenkins-hbase9:46717] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:36,440 INFO [RS:1;jenkins-hbase9:46717] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:36,440 INFO [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 22:03:36,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. after waiting 0 ms 2023-02-11 22:03:36,440 INFO [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-11 22:03:36,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. 2023-02-11 22:03:36,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 95672bafbb80c28b244f85f3b3b4e9d3 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 22:03:36,441 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:36,441 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:36,440 DEBUG [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 95672bafbb80c28b244f85f3b3b4e9d3=hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3.} 2023-02-11 22:03:36,441 DEBUG [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(1505): Waiting on 1588230740, 95672bafbb80c28b244f85f3b3b4e9d3 2023-02-11 22:03:36,441 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:36,441 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:36,441 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:36,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-11 22:03:36,447 DEBUG [RS:0;jenkins-hbase9:41239] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/oldWALs 2023-02-11 22:03:36,447 INFO [RS:0;jenkins-hbase9:41239] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41239%2C1676153013298:(num 1676153014636) 2023-02-11 22:03:36,447 DEBUG [RS:0;jenkins-hbase9:41239] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:36,447 INFO [RS:0;jenkins-hbase9:41239] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:36,448 INFO [RS:0;jenkins-hbase9:41239] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:36,448 INFO [RS:0;jenkins-hbase9:41239] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:36,448 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:36,448 INFO [RS:0;jenkins-hbase9:41239] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:36,448 INFO [RS:0;jenkins-hbase9:41239] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:36,454 INFO [RS:0;jenkins-hbase9:41239] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41239 2023-02-11 22:03:36,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3/.tmp/info/8a7409d14942428a8c93f111814916a4 2023-02-11 22:03:36,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/.tmp/info/2383d82f7cce4b0ca98226ef160b35f6 2023-02-11 22:03:36,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3/.tmp/info/8a7409d14942428a8c93f111814916a4 as hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3/info/8a7409d14942428a8c93f111814916a4 2023-02-11 22:03:36,479 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2383d82f7cce4b0ca98226ef160b35f6 2023-02-11 22:03:36,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3/info/8a7409d14942428a8c93f111814916a4, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 22:03:36,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 95672bafbb80c28b244f85f3b3b4e9d3 in 40ms, sequenceid=6, compaction requested=false 2023-02-11 22:03:36,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/namespace/95672bafbb80c28b244f85f3b3b4e9d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 22:03:36,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. 2023-02-11 22:03:36,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 95672bafbb80c28b244f85f3b3b4e9d3: Waiting for close lock at 1676153016437Running coprocessor pre-close hooks at 1676153016438 (+1 ms)Disabling compacts and flushes for region at 1676153016438Disabling writes for close at 1676153016440 (+2 ms)Obtaining lock to block concurrent updates at 1676153016441 (+1 ms)Preparing flush snapshotting stores in 95672bafbb80c28b244f85f3b3b4e9d3 at 1676153016441Finished memstore snapshotting hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676153016441Flushing stores of hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. at 1676153016443 (+2 ms)Flushing 95672bafbb80c28b244f85f3b3b4e9d3/info: creating writer at 1676153016443Flushing 95672bafbb80c28b244f85f3b3b4e9d3/info: appending metadata at 1676153016453 (+10 ms)Flushing 95672bafbb80c28b244f85f3b3b4e9d3/info: closing flushed file at 1676153016454 (+1 ms)Flushing 95672bafbb80c28b244f85f3b3b4e9d3/info: reopening flushed file at 1676153016477 (+23 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 95672bafbb80c28b244f85f3b3b4e9d3 in 40ms, sequenceid=6, compaction requested=false at 1676153016481 (+4 ms)Writing region close event to WAL at 1676153016482 (+1 ms)Running coprocessor post-close hooks at 1676153016485 (+3 ms)Closed at 1676153016485 2023-02-11 22:03:36,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676153013906.95672bafbb80c28b244f85f3b3b4e9d3. 2023-02-11 22:03:36,487 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/.tmp/rep_barrier/1a7393a496ee4a2d8b35193b69ec2f7d 2023-02-11 22:03:36,491 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a7393a496ee4a2d8b35193b69ec2f7d 2023-02-11 22:03:36,498 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/.tmp/table/abc250e5ff294985a710fa45ad26f485 2023-02-11 22:03:36,502 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for abc250e5ff294985a710fa45ad26f485 2023-02-11 22:03:36,502 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/.tmp/info/2383d82f7cce4b0ca98226ef160b35f6 as hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/info/2383d82f7cce4b0ca98226ef160b35f6 2023-02-11 22:03:36,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2383d82f7cce4b0ca98226ef160b35f6 2023-02-11 22:03:36,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/info/2383d82f7cce4b0ca98226ef160b35f6, entries=12, sequenceid=21, filesize=6.3 K 2023-02-11 22:03:36,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/.tmp/rep_barrier/1a7393a496ee4a2d8b35193b69ec2f7d as hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/rep_barrier/1a7393a496ee4a2d8b35193b69ec2f7d 2023-02-11 22:03:36,512 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a7393a496ee4a2d8b35193b69ec2f7d 2023-02-11 22:03:36,512 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/rep_barrier/1a7393a496ee4a2d8b35193b69ec2f7d, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 22:03:36,512 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:36,513 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:36,514 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/.tmp/table/abc250e5ff294985a710fa45ad26f485 as hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/table/abc250e5ff294985a710fa45ad26f485 2023-02-11 22:03:36,517 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for abc250e5ff294985a710fa45ad26f485 2023-02-11 22:03:36,518 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/table/abc250e5ff294985a710fa45ad26f485, entries=4, sequenceid=21, filesize=5.1 K 2023-02-11 22:03:36,518 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=21, compaction requested=false 2023-02-11 22:03:36,522 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-11 22:03:36,522 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 22:03:36,522 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:36,522 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153016440Running coprocessor pre-close hooks at 1676153016440Disabling compacts and flushes for region at 1676153016440Disabling writes for close at 1676153016441 (+1 ms)Obtaining lock to block concurrent updates at 1676153016442 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676153016442Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676153016442Flushing stores of hbase:meta,,1.1588230740 at 1676153016447 (+5 ms)Flushing 1588230740/info: creating writer at 1676153016447Flushing 1588230740/info: appending metadata at 1676153016454 (+7 ms)Flushing 1588230740/info: closing flushed file at 1676153016454Flushing 1588230740/rep_barrier: creating writer at 1676153016479 (+25 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676153016482 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676153016482Flushing 1588230740/table: creating writer at 1676153016491 (+9 ms)Flushing 1588230740/table: appending metadata at 1676153016493 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676153016493Flushing 1588230740/info: reopening flushed file at 1676153016503 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676153016508 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676153016514 (+6 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=21, compaction requested=false at 1676153016518 (+4 ms)Writing region close event to WAL at 1676153016519 (+1 ms)Running coprocessor post-close hooks at 1676153016522 (+3 ms)Closed at 1676153016522 2023-02-11 22:03:36,522 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:36,545 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:36,545 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:36,545 ERROR [Listener at localhost/42889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b8fbfa5 rejected from java.util.concurrent.ThreadPoolExecutor@1fb0380c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:36,545 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41239,1676153013298 2023-02-11 22:03:36,545 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:36,545 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:36,545 ERROR [Listener at localhost/42889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@db6de07 rejected from java.util.concurrent.ThreadPoolExecutor@1fb0380c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:36,547 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,41239,1676153013298] 2023-02-11 22:03:36,547 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,41239,1676153013298; numProcessing=1 2023-02-11 22:03:36,549 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,41239,1676153013298 already deleted, retry=false 2023-02-11 22:03:36,549 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,41239,1676153013298 expired; onlineServers=1 2023-02-11 22:03:36,610 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-11 22:03:36,610 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-11 22:03:36,641 INFO [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,46717,1676153013326; all regions closed. 2023-02-11 22:03:36,647 DEBUG [RS:1;jenkins-hbase9:46717] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/oldWALs 2023-02-11 22:03:36,647 INFO [RS:1;jenkins-hbase9:46717] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C46717%2C1676153013326.meta:.meta(num 1676153013844) 2023-02-11 22:03:36,651 DEBUG [RS:1;jenkins-hbase9:46717] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/oldWALs 2023-02-11 22:03:36,651 INFO [RS:1;jenkins-hbase9:46717] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C46717%2C1676153013326:(num 1676153014258) 2023-02-11 22:03:36,651 DEBUG [RS:1;jenkins-hbase9:46717] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:36,651 INFO [RS:1;jenkins-hbase9:46717] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:36,651 INFO [RS:1;jenkins-hbase9:46717] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:36,651 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:36,652 INFO [RS:1;jenkins-hbase9:46717] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:46717 2023-02-11 22:03:36,654 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,46717,1676153013326 2023-02-11 22:03:36,654 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:36,654 ERROR [Listener at localhost/42889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50a7f96f rejected from java.util.concurrent.ThreadPoolExecutor@549877a3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:36,655 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,46717,1676153013326] 2023-02-11 22:03:36,655 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,46717,1676153013326; numProcessing=2 2023-02-11 22:03:36,656 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,46717,1676153013326 already deleted, retry=false 2023-02-11 22:03:36,656 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,46717,1676153013326 expired; onlineServers=0 2023-02-11 22:03:36,656 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,37727,1676153013252' ***** 2023-02-11 22:03:36,656 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 22:03:36,656 DEBUG [M:0;jenkins-hbase9:37727] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52615087, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:36,656 INFO [M:0;jenkins-hbase9:37727] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,37727,1676153013252 2023-02-11 22:03:36,656 INFO [M:0;jenkins-hbase9:37727] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,37727,1676153013252; all regions closed. 2023-02-11 22:03:36,656 DEBUG [M:0;jenkins-hbase9:37727] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:36,656 DEBUG [M:0;jenkins-hbase9:37727] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 22:03:36,657 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 22:03:36,657 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153013486] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153013486,5,FailOnTimeoutGroup] 2023-02-11 22:03:36,657 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153013486] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153013486,5,FailOnTimeoutGroup] 2023-02-11 22:03:36,657 DEBUG [M:0;jenkins-hbase9:37727] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 22:03:36,658 INFO [M:0;jenkins-hbase9:37727] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 22:03:36,658 INFO [M:0;jenkins-hbase9:37727] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 22:03:36,658 INFO [M:0;jenkins-hbase9:37727] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-11 22:03:36,658 DEBUG [M:0;jenkins-hbase9:37727] master.HMaster(1502): Stopping service threads 2023-02-11 22:03:36,658 INFO [M:0;jenkins-hbase9:37727] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 22:03:36,659 ERROR [M:0;jenkins-hbase9:37727] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 22:03:36,659 INFO [M:0;jenkins-hbase9:37727] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 22:03:36,659 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 22:03:36,659 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:36,659 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:36,659 DEBUG [M:0;jenkins-hbase9:37727] zookeeper.ZKUtil(398): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 22:03:36,659 WARN [M:0;jenkins-hbase9:37727] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 22:03:36,660 INFO [M:0;jenkins-hbase9:37727] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 22:03:36,660 INFO [M:0;jenkins-hbase9:37727] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 22:03:36,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:36,661 DEBUG [M:0;jenkins-hbase9:37727] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:36,661 INFO [M:0;jenkins-hbase9:37727] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:36,661 DEBUG [M:0;jenkins-hbase9:37727] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:36,661 DEBUG [M:0;jenkins-hbase9:37727] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:36,661 DEBUG [M:0;jenkins-hbase9:37727] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:36,661 INFO [M:0;jenkins-hbase9:37727] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.88 KB heapSize=66.81 KB 2023-02-11 22:03:36,670 INFO [M:0;jenkins-hbase9:37727] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.88 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/217bb7ca7eae45c9a5ba87fae5ae2ec6 2023-02-11 22:03:36,674 DEBUG [M:0;jenkins-hbase9:37727] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/217bb7ca7eae45c9a5ba87fae5ae2ec6 as hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/217bb7ca7eae45c9a5ba87fae5ae2ec6 2023-02-11 22:03:36,678 INFO [M:0;jenkins-hbase9:37727] regionserver.HStore(1080): Added hdfs://localhost:39523/user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/217bb7ca7eae45c9a5ba87fae5ae2ec6, entries=17, sequenceid=132, filesize=8.7 K 2023-02-11 22:03:36,679 INFO [M:0;jenkins-hbase9:37727] regionserver.HRegion(2947): Finished flush of dataSize ~55.88 KB/57220, heapSize ~66.80 KB/68400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-11 22:03:36,679 INFO [M:0;jenkins-hbase9:37727] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:36,679 DEBUG [M:0;jenkins-hbase9:37727] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153016660Disabling compacts and flushes for region at 1676153016660Disabling writes for close at 1676153016661 (+1 ms)Obtaining lock to block concurrent updates at 1676153016661Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676153016661Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57220, getHeapSize=68400, getOffHeapSize=0, getCellsCount=145 at 1676153016661Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676153016662 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676153016662Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676153016664 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676153016664Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676153016675 (+11 ms)Finished flush of dataSize ~55.88 KB/57220, heapSize ~66.80 KB/68400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1676153016679 (+4 ms)Writing region close event to WAL at 1676153016679Closed at 1676153016679 2023-02-11 22:03:36,682 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/a6d1aba3-ef42-f388-c819-b6824fd93518/MasterData/WALs/jenkins-hbase9.apache.org,37727,1676153013252/jenkins-hbase9.apache.org%2C37727%2C1676153013252.1676153013412 not finished, retry = 0 2023-02-11 22:03:36,784 INFO [M:0;jenkins-hbase9:37727] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 22:03:36,784 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:36,784 INFO [M:0;jenkins-hbase9:37727] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:37727 2023-02-11 22:03:36,786 DEBUG [M:0;jenkins-hbase9:37727] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,37727,1676153013252 already deleted, retry=false 2023-02-11 22:03:36,834 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:36,834 INFO [RS:1;jenkins-hbase9:46717] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,46717,1676153013326; zookeeper connection closed. 2023-02-11 22:03:36,834 ERROR [Listener at localhost/42889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4fc2f330 rejected from java.util.concurrent.ThreadPoolExecutor@549877a3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:36,834 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3a61ad9e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3a61ad9e 2023-02-11 22:03:36,834 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:46717-0x100456a23e00002, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:36,834 ERROR [Listener at localhost/42889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@377359f2 rejected from java.util.concurrent.ThreadPoolExecutor@549877a3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:36,934 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:36,934 INFO [RS:0;jenkins-hbase9:41239] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,41239,1676153013298; zookeeper connection closed. 2023-02-11 22:03:36,934 ERROR [Listener at localhost/42889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@754c1fa3 rejected from java.util.concurrent.ThreadPoolExecutor@1fb0380c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:36,934 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): regionserver:41239-0x100456a23e00001, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:36,934 ERROR [Listener at localhost/42889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e0fd63 rejected from java.util.concurrent.ThreadPoolExecutor@1fb0380c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:36,948 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d918a96] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d918a96 2023-02-11 22:03:36,949 INFO [Listener at localhost/42889] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 22:03:37,034 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:37,034 INFO [M:0;jenkins-hbase9:37727] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,37727,1676153013252; zookeeper connection closed. 2023-02-11 22:03:37,034 ERROR [Listener at localhost/42889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43a4e4bb rejected from java.util.concurrent.ThreadPoolExecutor@479b6817[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:37,035 DEBUG [Listener at localhost/42889-EventThread] zookeeper.ZKWatcher(600): master:37727-0x100456a23e00000, quorum=127.0.0.1:62800, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:37,035 ERROR [Listener at localhost/42889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5734ad8f rejected from java.util.concurrent.ThreadPoolExecutor@479b6817[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:37,035 WARN [Listener at localhost/42889] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:37,039 INFO [Listener at localhost/42889] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:37,144 WARN [BP-845180359-172.31.2.10-1676153012453 heartbeating to localhost/127.0.0.1:39523] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:37,144 WARN [BP-845180359-172.31.2.10-1676153012453 heartbeating to localhost/127.0.0.1:39523] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-845180359-172.31.2.10-1676153012453 (Datanode Uuid 85da286c-74b6-4785-8733-19dc60139726) service to localhost/127.0.0.1:39523 2023-02-11 22:03:37,145 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/cluster_96b19853-4550-94fb-3f61-05f2411e3df4/dfs/data/data3/current/BP-845180359-172.31.2.10-1676153012453] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:37,145 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/cluster_96b19853-4550-94fb-3f61-05f2411e3df4/dfs/data/data4/current/BP-845180359-172.31.2.10-1676153012453] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:37,147 WARN [Listener at localhost/42889] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:37,150 INFO [Listener at localhost/42889] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:37,256 WARN [BP-845180359-172.31.2.10-1676153012453 heartbeating to localhost/127.0.0.1:39523] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:37,256 WARN [BP-845180359-172.31.2.10-1676153012453 heartbeating to localhost/127.0.0.1:39523] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-845180359-172.31.2.10-1676153012453 (Datanode Uuid 703dc352-3a07-468e-91ed-a5561c637cc3) service to localhost/127.0.0.1:39523 2023-02-11 22:03:37,256 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/cluster_96b19853-4550-94fb-3f61-05f2411e3df4/dfs/data/data1/current/BP-845180359-172.31.2.10-1676153012453] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:37,257 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/cluster_96b19853-4550-94fb-3f61-05f2411e3df4/dfs/data/data2/current/BP-845180359-172.31.2.10-1676153012453] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:37,266 INFO [Listener at localhost/42889] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:37,380 INFO [Listener at localhost/42889] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 22:03:37,395 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 22:03:37,406 INFO [Listener at localhost/42889] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=177 (was 158) Potentially hanging thread: Listener at localhost/42889 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:39523 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:39523 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:39523 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:39523 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39523 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,37727,1676153013252)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:39523 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:39523 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=564 (was 537) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=285 (was 267) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=9699 (was 9729) 2023-02-11 22:03:37,415 INFO [Listener at localhost/42889] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=177, OpenFileDescriptor=564, MaxFileDescriptor=60000, SystemLoadAverage=285, ProcessCount=166, AvailableMemoryMB=9699 2023-02-11 22:03:37,425 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/hadoop.log.dir so I do NOT create it in target/test-data/829b629e-3ba9-a453-756e-21c195c43def 2023-02-11 22:03:37,425 WARN [Listener at localhost/42889] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 22:03:37,425 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/hadoop.tmp.dir so I do NOT create it in target/test-data/829b629e-3ba9-a453-756e-21c195c43def 2023-02-11 22:03:37,425 WARN [Listener at localhost/42889] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a8260e31-f900-d2b9-633c-3371cd6dc0cc/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 22:03:37,425 DEBUG [Listener at localhost/42889] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def 2023-02-11 22:03:37,425 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 22:03:37,425 INFO [Listener at localhost/42889] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/cluster_9dac571f-6391-e26e-ddfd-bedff2be36e5, deleteOnExit=true 2023-02-11 22:03:37,425 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 22:03:37,426 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/test.cache.data in system properties and HBase conf 2023-02-11 22:03:37,426 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 22:03:37,426 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/hadoop.log.dir in system properties and HBase conf 2023-02-11 22:03:37,426 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 22:03:37,426 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 22:03:37,426 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 22:03:37,426 DEBUG [Listener at localhost/42889] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 22:03:37,426 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:37,426 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:37,426 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 22:03:37,427 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:37,427 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 22:03:37,427 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 22:03:37,427 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:37,427 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:37,427 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 22:03:37,427 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/nfs.dump.dir in system properties and HBase conf 2023-02-11 22:03:37,427 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/java.io.tmpdir in system properties and HBase conf 2023-02-11 22:03:37,427 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:37,427 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 22:03:37,427 INFO [Listener at localhost/42889] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 22:03:37,431 WARN [Listener at localhost/42889] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:37,432 WARN [Listener at localhost/42889] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:37,473 WARN [Listener at localhost/42889] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:37,475 INFO [Listener at localhost/42889] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:37,480 INFO [Listener at localhost/42889] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/java.io.tmpdir/Jetty_localhost_41241_hdfs____fe3hoc/webapp 2023-02-11 22:03:37,574 INFO [Listener at localhost/42889] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41241 2023-02-11 22:03:37,578 WARN [Listener at localhost/42889] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:37,578 WARN [Listener at localhost/42889] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:37,616 WARN [Listener at localhost/36467] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:37,630 WARN [Listener at localhost/36467] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:37,635 WARN [Listener at localhost/36467] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:37,636 INFO [Listener at localhost/36467] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:37,640 INFO [Listener at localhost/36467] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/java.io.tmpdir/Jetty_localhost_44943_datanode____doxxpb/webapp 2023-02-11 22:03:37,732 INFO [Listener at localhost/36467] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44943 2023-02-11 22:03:37,740 WARN [Listener at localhost/43721] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:37,760 WARN [Listener at localhost/43721] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:37,762 WARN [Listener at localhost/43721] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:37,763 INFO [Listener at localhost/43721] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:37,767 INFO [Listener at localhost/43721] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/java.io.tmpdir/Jetty_localhost_35617_datanode____.f81syn/webapp 2023-02-11 22:03:37,835 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe5d430374daab417: Processing first storage report for DS-1f04d3e2-0a45-4c06-bef6-4c7b6ac886a8 from datanode 2a65c097-69ae-4efc-bc8b-b22e71691aa5 2023-02-11 22:03:37,836 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe5d430374daab417: from storage DS-1f04d3e2-0a45-4c06-bef6-4c7b6ac886a8 node DatanodeRegistration(127.0.0.1:35187, datanodeUuid=2a65c097-69ae-4efc-bc8b-b22e71691aa5, infoPort=40807, infoSecurePort=0, ipcPort=43721, storageInfo=lv=-57;cid=testClusterID;nsid=892145649;c=1676153017434), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:37,836 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe5d430374daab417: Processing first storage report for DS-0095f104-c65e-4a72-b90a-75c40380a7f6 from datanode 2a65c097-69ae-4efc-bc8b-b22e71691aa5 2023-02-11 22:03:37,836 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe5d430374daab417: from storage DS-0095f104-c65e-4a72-b90a-75c40380a7f6 node DatanodeRegistration(127.0.0.1:35187, datanodeUuid=2a65c097-69ae-4efc-bc8b-b22e71691aa5, infoPort=40807, infoSecurePort=0, ipcPort=43721, storageInfo=lv=-57;cid=testClusterID;nsid=892145649;c=1676153017434), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:37,876 INFO [Listener at localhost/43721] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35617 2023-02-11 22:03:37,885 WARN [Listener at localhost/43127] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:37,981 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9773a9ec27371af9: Processing first storage report for DS-59c5e485-3ab9-4f56-9b69-ad8102c40d3b from datanode 8382ec63-3454-43cc-b2db-819efc7b6815 2023-02-11 22:03:37,981 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9773a9ec27371af9: from storage DS-59c5e485-3ab9-4f56-9b69-ad8102c40d3b node DatanodeRegistration(127.0.0.1:46197, datanodeUuid=8382ec63-3454-43cc-b2db-819efc7b6815, infoPort=33141, infoSecurePort=0, ipcPort=43127, storageInfo=lv=-57;cid=testClusterID;nsid=892145649;c=1676153017434), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:37,981 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9773a9ec27371af9: Processing first storage report for DS-79e4c6a8-8c56-4e2f-b755-e1d83291e364 from datanode 8382ec63-3454-43cc-b2db-819efc7b6815 2023-02-11 22:03:37,981 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9773a9ec27371af9: from storage DS-79e4c6a8-8c56-4e2f-b755-e1d83291e364 node DatanodeRegistration(127.0.0.1:46197, datanodeUuid=8382ec63-3454-43cc-b2db-819efc7b6815, infoPort=33141, infoSecurePort=0, ipcPort=43127, storageInfo=lv=-57;cid=testClusterID;nsid=892145649;c=1676153017434), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:37,998 DEBUG [Listener at localhost/43127] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def 2023-02-11 22:03:37,999 INFO [Listener at localhost/43127] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/cluster_9dac571f-6391-e26e-ddfd-bedff2be36e5/zookeeper_0, clientPort=58447, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/cluster_9dac571f-6391-e26e-ddfd-bedff2be36e5/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/cluster_9dac571f-6391-e26e-ddfd-bedff2be36e5/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 22:03:38,000 INFO [Listener at localhost/43127] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58447 2023-02-11 22:03:38,001 INFO [Listener at localhost/43127] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:38,001 INFO [Listener at localhost/43127] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:38,014 INFO [Listener at localhost/43127] util.FSUtils(479): Created version file at hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d with version=8 2023-02-11 22:03:38,015 INFO [Listener at localhost/43127] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:38,015 INFO [Listener at localhost/43127] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:38,016 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/hbase-staging 2023-02-11 22:03:38,018 INFO [Listener at localhost/43127] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:38,019 INFO [Listener at localhost/43127] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:38,019 INFO [Listener at localhost/43127] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:38,019 INFO [Listener at localhost/43127] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:38,019 INFO [Listener at localhost/43127] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:38,019 INFO [Listener at localhost/43127] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:38,019 INFO [Listener at localhost/43127] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:38,020 INFO [Listener at localhost/43127] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35513 2023-02-11 22:03:38,020 INFO [Listener at localhost/43127] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:38,021 INFO [Listener at localhost/43127] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:38,022 INFO [Listener at localhost/43127] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35513 connecting to ZooKeeper ensemble=127.0.0.1:58447 2023-02-11 22:03:38,032 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:355130x0, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:38,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35513-0x100456a367d0000 connected 2023-02-11 22:03:38,052 DEBUG [Listener at localhost/43127] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:38,052 DEBUG [Listener at localhost/43127] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:38,053 DEBUG [Listener at localhost/43127] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:38,055 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35513 2023-02-11 22:03:38,055 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35513 2023-02-11 22:03:38,056 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35513 2023-02-11 22:03:38,059 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35513 2023-02-11 22:03:38,062 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35513 2023-02-11 22:03:38,062 INFO [Listener at localhost/43127] master.HMaster(439): hbase.rootdir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d, hbase.cluster.distributed=false 2023-02-11 22:03:38,074 INFO [Listener at localhost/43127] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:38,074 INFO [Listener at localhost/43127] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:38,074 INFO [Listener at localhost/43127] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:38,074 INFO [Listener at localhost/43127] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:38,074 INFO [Listener at localhost/43127] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:38,074 INFO [Listener at localhost/43127] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:38,074 INFO [Listener at localhost/43127] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:38,075 INFO [Listener at localhost/43127] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45137 2023-02-11 22:03:38,075 INFO [Listener at localhost/43127] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:38,076 DEBUG [Listener at localhost/43127] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:38,077 INFO [Listener at localhost/43127] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:38,077 INFO [Listener at localhost/43127] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:38,078 INFO [Listener at localhost/43127] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45137 connecting to ZooKeeper ensemble=127.0.0.1:58447 2023-02-11 22:03:38,081 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:451370x0, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:38,082 DEBUG [Listener at localhost/43127] zookeeper.ZKUtil(164): regionserver:451370x0, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:38,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45137-0x100456a367d0001 connected 2023-02-11 22:03:38,083 DEBUG [Listener at localhost/43127] zookeeper.ZKUtil(164): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:38,083 DEBUG [Listener at localhost/43127] zookeeper.ZKUtil(164): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:38,087 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45137 2023-02-11 22:03:38,087 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45137 2023-02-11 22:03:38,087 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45137 2023-02-11 22:03:38,091 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45137 2023-02-11 22:03:38,091 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45137 2023-02-11 22:03:38,101 INFO [Listener at localhost/43127] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:38,101 INFO [Listener at localhost/43127] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:38,101 INFO [Listener at localhost/43127] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:38,101 INFO [Listener at localhost/43127] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:38,102 INFO [Listener at localhost/43127] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:38,102 INFO [Listener at localhost/43127] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:38,102 INFO [Listener at localhost/43127] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:38,102 INFO [Listener at localhost/43127] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35641 2023-02-11 22:03:38,103 INFO [Listener at localhost/43127] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:38,103 DEBUG [Listener at localhost/43127] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:38,104 INFO [Listener at localhost/43127] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:38,105 INFO [Listener at localhost/43127] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:38,105 INFO [Listener at localhost/43127] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35641 connecting to ZooKeeper ensemble=127.0.0.1:58447 2023-02-11 22:03:38,108 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:356410x0, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:38,109 DEBUG [Listener at localhost/43127] zookeeper.ZKUtil(164): regionserver:356410x0, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:38,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35641-0x100456a367d0002 connected 2023-02-11 22:03:38,110 DEBUG [Listener at localhost/43127] zookeeper.ZKUtil(164): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:38,110 DEBUG [Listener at localhost/43127] zookeeper.ZKUtil(164): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:38,111 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35641 2023-02-11 22:03:38,111 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35641 2023-02-11 22:03:38,115 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35641 2023-02-11 22:03:38,115 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35641 2023-02-11 22:03:38,117 DEBUG [Listener at localhost/43127] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35641 2023-02-11 22:03:38,119 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,35513,1676153018018 2023-02-11 22:03:38,121 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:38,121 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,35513,1676153018018 2023-02-11 22:03:38,123 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:38,123 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:38,123 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:38,123 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:38,124 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:38,125 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,35513,1676153018018 from backup master directory 2023-02-11 22:03:38,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:38,126 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,35513,1676153018018 2023-02-11 22:03:38,126 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:38,126 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:38,126 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,35513,1676153018018 2023-02-11 22:03:38,140 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/hbase.id with ID: 4fd889c1-1d74-4906-af5c-0296380ca792 2023-02-11 22:03:38,149 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:38,151 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:38,163 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3356ac23 to 127.0.0.1:58447 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:38,168 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b15de06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:38,168 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:38,169 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 22:03:38,169 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:38,170 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/data/master/store-tmp 2023-02-11 22:03:38,177 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:38,177 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:38,177 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:38,177 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:38,177 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:38,177 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:38,177 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:38,177 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153018177Disabling compacts and flushes for region at 1676153018177Disabling writes for close at 1676153018177Writing region close event to WAL at 1676153018177Closed at 1676153018177 2023-02-11 22:03:38,178 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/WALs/jenkins-hbase9.apache.org,35513,1676153018018 2023-02-11 22:03:38,180 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35513%2C1676153018018, suffix=, logDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/WALs/jenkins-hbase9.apache.org,35513,1676153018018, archiveDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/oldWALs, maxLogs=10 2023-02-11 22:03:38,199 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35187,DS-1f04d3e2-0a45-4c06-bef6-4c7b6ac886a8,DISK] 2023-02-11 22:03:38,200 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46197,DS-59c5e485-3ab9-4f56-9b69-ad8102c40d3b,DISK] 2023-02-11 22:03:38,202 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/WALs/jenkins-hbase9.apache.org,35513,1676153018018/jenkins-hbase9.apache.org%2C35513%2C1676153018018.1676153018180 2023-02-11 22:03:38,202 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35187,DS-1f04d3e2-0a45-4c06-bef6-4c7b6ac886a8,DISK], DatanodeInfoWithStorage[127.0.0.1:46197,DS-59c5e485-3ab9-4f56-9b69-ad8102c40d3b,DISK]] 2023-02-11 22:03:38,202 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:38,202 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:38,202 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:38,203 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:38,207 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:38,208 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 22:03:38,209 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 22:03:38,209 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:38,210 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:38,210 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:38,212 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:38,214 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:38,214 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61135788, jitterRate=-0.08900576829910278}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:38,215 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676153018203Initializing all the Stores at 1676153018203Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153018203Cleaning up temporary data from old regions at 1676153018210 (+7 ms)Cleaning up detritus from prior splits at 1676153018211 (+1 ms)Region opened successfully at 1676153018214 (+3 ms) 2023-02-11 22:03:38,215 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 22:03:38,216 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 22:03:38,216 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 22:03:38,216 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 22:03:38,216 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 22:03:38,217 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 22:03:38,217 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 22:03:38,219 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 22:03:38,220 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 22:03:38,230 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 22:03:38,230 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 22:03:38,230 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 22:03:38,230 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 22:03:38,231 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 22:03:38,232 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:38,233 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 22:03:38,233 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 22:03:38,234 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 22:03:38,235 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:38,235 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:38,235 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:38,235 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:38,235 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,35513,1676153018018, sessionid=0x100456a367d0000, setting cluster-up flag (Was=false) 2023-02-11 22:03:38,242 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:38,245 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 22:03:38,246 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35513,1676153018018 2023-02-11 22:03:38,249 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:38,253 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 22:03:38,254 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35513,1676153018018 2023-02-11 22:03:38,254 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.hbase-snapshot/.tmp 2023-02-11 22:03:38,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:38,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:38,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:38,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:38,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:38,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-11 22:03:38,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:38,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,263 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676153048263 2023-02-11 22:03:38,263 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 22:03:38,263 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 22:03:38,263 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 22:03:38,263 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 22:03:38,263 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 22:03:38,263 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 22:03:38,264 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,264 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:38,264 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 22:03:38,264 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 22:03:38,265 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 22:03:38,265 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 22:03:38,265 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 22:03:38,265 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 22:03:38,266 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:38,267 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153018265,5,FailOnTimeoutGroup] 2023-02-11 22:03:38,269 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153018267,5,FailOnTimeoutGroup] 2023-02-11 22:03:38,269 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,269 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 22:03:38,269 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,269 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,280 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:38,280 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:38,280 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d 2023-02-11 22:03:38,289 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:38,290 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:38,292 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/info 2023-02-11 22:03:38,292 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:38,293 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:38,293 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:38,294 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:38,294 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:38,295 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:38,295 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:38,296 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/table 2023-02-11 22:03:38,296 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:38,297 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:38,297 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740 2023-02-11 22:03:38,298 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740 2023-02-11 22:03:38,299 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:38,300 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:38,301 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:38,302 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60448420, jitterRate=-0.09924834966659546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:38,302 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676153018289Initializing all the Stores at 1676153018290 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153018290Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153018290Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153018290Cleaning up temporary data from old regions at 1676153018298 (+8 ms)Cleaning up detritus from prior splits at 1676153018299 (+1 ms)Region opened successfully at 1676153018302 (+3 ms) 2023-02-11 22:03:38,302 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:38,302 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:38,302 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:38,302 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:38,302 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:38,302 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:38,302 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153018302Disabling compacts and flushes for region at 1676153018302Disabling writes for close at 1676153018302Writing region close event to WAL at 1676153018302Closed at 1676153018302 2023-02-11 22:03:38,303 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:38,303 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 22:03:38,303 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 22:03:38,305 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 22:03:38,306 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 22:03:38,319 INFO [RS:1;jenkins-hbase9:35641] regionserver.HRegionServer(952): ClusterId : 4fd889c1-1d74-4906-af5c-0296380ca792 2023-02-11 22:03:38,319 INFO [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(952): ClusterId : 4fd889c1-1d74-4906-af5c-0296380ca792 2023-02-11 22:03:38,319 DEBUG [RS:1;jenkins-hbase9:35641] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:38,319 DEBUG [RS:0;jenkins-hbase9:45137] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:38,321 DEBUG [RS:1;jenkins-hbase9:35641] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:38,321 DEBUG [RS:1;jenkins-hbase9:35641] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:38,321 DEBUG [RS:0;jenkins-hbase9:45137] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:38,321 DEBUG [RS:0;jenkins-hbase9:45137] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:38,323 DEBUG [RS:1;jenkins-hbase9:35641] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:38,324 DEBUG [RS:0;jenkins-hbase9:45137] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:38,324 DEBUG [RS:1;jenkins-hbase9:35641] zookeeper.ReadOnlyZKClient(139): Connect 0x10f13ee9 to 127.0.0.1:58447 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:38,325 DEBUG [RS:0;jenkins-hbase9:45137] zookeeper.ReadOnlyZKClient(139): Connect 0x02791c42 to 127.0.0.1:58447 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:38,340 DEBUG [RS:1;jenkins-hbase9:35641] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e36c287, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:38,340 DEBUG [RS:0;jenkins-hbase9:45137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cbef27d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:38,340 DEBUG [RS:1;jenkins-hbase9:35641] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a095599, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:38,341 DEBUG [RS:0;jenkins-hbase9:45137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8817732, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:38,351 DEBUG [RS:0;jenkins-hbase9:45137] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:45137 2023-02-11 22:03:38,351 INFO [RS:0;jenkins-hbase9:45137] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:38,351 INFO [RS:0;jenkins-hbase9:45137] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:38,351 DEBUG [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:38,351 INFO [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,35513,1676153018018 with isa=jenkins-hbase9.apache.org/172.31.2.10:45137, startcode=1676153018073 2023-02-11 22:03:38,352 DEBUG [RS:0;jenkins-hbase9:45137] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:38,353 DEBUG [RS:1;jenkins-hbase9:35641] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:35641 2023-02-11 22:03:38,353 INFO [RS:1;jenkins-hbase9:35641] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:38,353 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51327, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:38,353 INFO [RS:1;jenkins-hbase9:35641] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:38,353 DEBUG [RS:1;jenkins-hbase9:35641] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:38,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:38,355 INFO [RS:1;jenkins-hbase9:35641] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,35513,1676153018018 with isa=jenkins-hbase9.apache.org/172.31.2.10:35641, startcode=1676153018101 2023-02-11 22:03:38,355 DEBUG [RS:1;jenkins-hbase9:35641] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:38,355 DEBUG [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d 2023-02-11 22:03:38,355 DEBUG [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36467 2023-02-11 22:03:38,355 DEBUG [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:38,356 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:38,357 DEBUG [RS:0;jenkins-hbase9:45137] zookeeper.ZKUtil(162): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:38,357 WARN [RS:0;jenkins-hbase9:45137] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:38,357 INFO [RS:0;jenkins-hbase9:45137] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:38,357 DEBUG [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/WALs/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:38,359 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59765, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:38,359 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,45137,1676153018073] 2023-02-11 22:03:38,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:38,362 DEBUG [RS:1;jenkins-hbase9:35641] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d 2023-02-11 22:03:38,362 DEBUG [RS:1;jenkins-hbase9:35641] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36467 2023-02-11 22:03:38,362 DEBUG [RS:1;jenkins-hbase9:35641] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:38,367 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:38,367 DEBUG [RS:1;jenkins-hbase9:35641] zookeeper.ZKUtil(162): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:38,367 WARN [RS:1;jenkins-hbase9:35641] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:38,367 INFO [RS:1;jenkins-hbase9:35641] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:38,368 DEBUG [RS:1;jenkins-hbase9:35641] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/WALs/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:38,368 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,35641,1676153018101] 2023-02-11 22:03:38,368 DEBUG [RS:0;jenkins-hbase9:45137] zookeeper.ZKUtil(162): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:38,368 DEBUG [RS:0;jenkins-hbase9:45137] zookeeper.ZKUtil(162): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:38,370 DEBUG [RS:0;jenkins-hbase9:45137] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:38,370 INFO [RS:0;jenkins-hbase9:45137] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:38,371 DEBUG [RS:1;jenkins-hbase9:35641] zookeeper.ZKUtil(162): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:38,371 DEBUG [RS:1;jenkins-hbase9:35641] zookeeper.ZKUtil(162): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:38,372 DEBUG [RS:1;jenkins-hbase9:35641] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:38,372 INFO [RS:1;jenkins-hbase9:35641] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:38,373 INFO [RS:0;jenkins-hbase9:45137] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:38,373 INFO [RS:1;jenkins-hbase9:35641] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:38,374 INFO [RS:0;jenkins-hbase9:45137] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:38,374 INFO [RS:0;jenkins-hbase9:45137] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,374 INFO [RS:1;jenkins-hbase9:35641] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:38,374 INFO [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:38,374 INFO [RS:1;jenkins-hbase9:35641] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,375 INFO [RS:1;jenkins-hbase9:35641] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:38,376 INFO [RS:0;jenkins-hbase9:45137] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,376 INFO [RS:1;jenkins-hbase9:35641] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,376 DEBUG [RS:0;jenkins-hbase9:45137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:0;jenkins-hbase9:45137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:1;jenkins-hbase9:35641] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:0;jenkins-hbase9:45137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:1;jenkins-hbase9:35641] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:0;jenkins-hbase9:45137] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:1;jenkins-hbase9:35641] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:0;jenkins-hbase9:45137] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:1;jenkins-hbase9:35641] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:0;jenkins-hbase9:45137] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:38,376 DEBUG [RS:1;jenkins-hbase9:35641] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:0;jenkins-hbase9:45137] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:1;jenkins-hbase9:35641] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:38,376 DEBUG [RS:0;jenkins-hbase9:45137] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:1;jenkins-hbase9:35641] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:0;jenkins-hbase9:45137] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:1;jenkins-hbase9:35641] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:0;jenkins-hbase9:45137] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:1;jenkins-hbase9:35641] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,376 DEBUG [RS:1;jenkins-hbase9:35641] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:38,379 INFO [RS:0;jenkins-hbase9:45137] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,379 INFO [RS:0;jenkins-hbase9:45137] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,380 INFO [RS:0;jenkins-hbase9:45137] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,382 INFO [RS:1;jenkins-hbase9:35641] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,382 INFO [RS:1;jenkins-hbase9:35641] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,382 INFO [RS:1;jenkins-hbase9:35641] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,392 INFO [RS:0;jenkins-hbase9:45137] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:38,392 INFO [RS:1;jenkins-hbase9:35641] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:38,392 INFO [RS:0;jenkins-hbase9:45137] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45137,1676153018073-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,392 INFO [RS:1;jenkins-hbase9:35641] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35641,1676153018101-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,405 INFO [RS:1;jenkins-hbase9:35641] regionserver.Replication(203): jenkins-hbase9.apache.org,35641,1676153018101 started 2023-02-11 22:03:38,405 INFO [RS:1;jenkins-hbase9:35641] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,35641,1676153018101, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:35641, sessionid=0x100456a367d0002 2023-02-11 22:03:38,405 DEBUG [RS:1;jenkins-hbase9:35641] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:38,405 DEBUG [RS:1;jenkins-hbase9:35641] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:38,405 DEBUG [RS:1;jenkins-hbase9:35641] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35641,1676153018101' 2023-02-11 22:03:38,405 DEBUG [RS:1;jenkins-hbase9:35641] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:38,405 DEBUG [RS:1;jenkins-hbase9:35641] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:38,405 DEBUG [RS:1;jenkins-hbase9:35641] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:38,405 DEBUG [RS:1;jenkins-hbase9:35641] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:38,405 DEBUG [RS:1;jenkins-hbase9:35641] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:38,405 DEBUG [RS:1;jenkins-hbase9:35641] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35641,1676153018101' 2023-02-11 22:03:38,406 DEBUG [RS:1;jenkins-hbase9:35641] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:38,406 DEBUG [RS:1;jenkins-hbase9:35641] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:38,406 DEBUG [RS:1;jenkins-hbase9:35641] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:38,406 INFO [RS:1;jenkins-hbase9:35641] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:38,406 INFO [RS:1;jenkins-hbase9:35641] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:38,407 INFO [RS:0;jenkins-hbase9:45137] regionserver.Replication(203): jenkins-hbase9.apache.org,45137,1676153018073 started 2023-02-11 22:03:38,407 INFO [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,45137,1676153018073, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:45137, sessionid=0x100456a367d0001 2023-02-11 22:03:38,407 DEBUG [RS:0;jenkins-hbase9:45137] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:38,407 DEBUG [RS:0;jenkins-hbase9:45137] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:38,407 DEBUG [RS:0;jenkins-hbase9:45137] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45137,1676153018073' 2023-02-11 22:03:38,407 DEBUG [RS:0;jenkins-hbase9:45137] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:38,408 DEBUG [RS:0;jenkins-hbase9:45137] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:38,408 DEBUG [RS:0;jenkins-hbase9:45137] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:38,408 DEBUG [RS:0;jenkins-hbase9:45137] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:38,408 DEBUG [RS:0;jenkins-hbase9:45137] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:38,408 DEBUG [RS:0;jenkins-hbase9:45137] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45137,1676153018073' 2023-02-11 22:03:38,408 DEBUG [RS:0;jenkins-hbase9:45137] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:38,408 DEBUG [RS:0;jenkins-hbase9:45137] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:38,409 DEBUG [RS:0;jenkins-hbase9:45137] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:38,409 INFO [RS:0;jenkins-hbase9:45137] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:38,409 INFO [RS:0;jenkins-hbase9:45137] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:38,456 DEBUG [jenkins-hbase9:35513] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 22:03:38,456 DEBUG [jenkins-hbase9:35513] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:38,458 DEBUG [jenkins-hbase9:35513] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:38,458 DEBUG [jenkins-hbase9:35513] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:38,458 DEBUG [jenkins-hbase9:35513] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:38,459 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,45137,1676153018073, state=OPENING 2023-02-11 22:03:38,460 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 22:03:38,461 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:38,462 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:38,462 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,45137,1676153018073}] 2023-02-11 22:03:38,616 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:38,616 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 22:03:38,618 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51976, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 22:03:38,622 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 22:03:38,623 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:38,624 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45137%2C1676153018073.meta, suffix=.meta, logDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/WALs/jenkins-hbase9.apache.org,45137,1676153018073, archiveDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/oldWALs, maxLogs=32 2023-02-11 22:03:38,637 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35187,DS-1f04d3e2-0a45-4c06-bef6-4c7b6ac886a8,DISK] 2023-02-11 22:03:38,639 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46197,DS-59c5e485-3ab9-4f56-9b69-ad8102c40d3b,DISK] 2023-02-11 22:03:38,640 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/WALs/jenkins-hbase9.apache.org,45137,1676153018073/jenkins-hbase9.apache.org%2C45137%2C1676153018073.meta.1676153018624.meta 2023-02-11 22:03:38,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35187,DS-1f04d3e2-0a45-4c06-bef6-4c7b6ac886a8,DISK], DatanodeInfoWithStorage[127.0.0.1:46197,DS-59c5e485-3ab9-4f56-9b69-ad8102c40d3b,DISK]] 2023-02-11 22:03:38,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:38,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 22:03:38,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 22:03:38,641 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 22:03:38,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 22:03:38,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:38,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 22:03:38,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 22:03:38,643 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:38,643 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/info 2023-02-11 22:03:38,643 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/info 2023-02-11 22:03:38,644 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:38,644 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:38,644 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:38,645 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:38,645 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:38,645 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:38,646 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:38,646 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:38,646 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/table 2023-02-11 22:03:38,646 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/table 2023-02-11 22:03:38,647 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:38,647 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:38,648 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740 2023-02-11 22:03:38,649 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740 2023-02-11 22:03:38,650 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:38,651 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:38,652 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70599588, jitterRate=0.052015841007232666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:38,652 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676153018642Writing region info on filesystem at 1676153018642Initializing all the Stores at 1676153018642Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153018642Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153018642Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153018642Cleaning up temporary data from old regions at 1676153018649 (+7 ms)Cleaning up detritus from prior splits at 1676153018650 (+1 ms)Running coprocessor post-open hooks at 1676153018652 (+2 ms)Region opened successfully at 1676153018652 2023-02-11 22:03:38,653 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676153018616 2023-02-11 22:03:38,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 22:03:38,658 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 22:03:38,658 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,45137,1676153018073, state=OPEN 2023-02-11 22:03:38,659 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 22:03:38,659 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:38,661 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 22:03:38,661 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,45137,1676153018073 in 197 msec 2023-02-11 22:03:38,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 22:03:38,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 358 msec 2023-02-11 22:03:38,663 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 407 msec 2023-02-11 22:03:38,663 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676153018121, completionTime=-1 2023-02-11 22:03:38,663 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 22:03:38,663 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 22:03:38,666 DEBUG [hconnection-0x7fff349a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:38,667 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:38,668 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 22:03:38,668 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676153078668 2023-02-11 22:03:38,668 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676153138668 2023-02-11 22:03:38,668 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-11 22:03:38,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35513,1676153018018-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35513,1676153018018-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35513,1676153018018-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:35513, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:38,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 22:03:38,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:38,675 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 22:03:38,676 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 22:03:38,676 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:38,677 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:38,678 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9 2023-02-11 22:03:38,679 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9 empty. 2023-02-11 22:03:38,679 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9 2023-02-11 22:03:38,679 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 22:03:38,694 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:38,695 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9d56d77650c9b6ce560336202ed7a4e9, NAME => 'hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp 2023-02-11 22:03:38,706 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:38,706 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 9d56d77650c9b6ce560336202ed7a4e9, disabling compactions & flushes 2023-02-11 22:03:38,706 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. 2023-02-11 22:03:38,706 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. 2023-02-11 22:03:38,707 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. after waiting 0 ms 2023-02-11 22:03:38,707 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. 2023-02-11 22:03:38,707 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. 2023-02-11 22:03:38,707 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 9d56d77650c9b6ce560336202ed7a4e9: Waiting for close lock at 1676153018706Disabling compacts and flushes for region at 1676153018706Disabling writes for close at 1676153018707 (+1 ms)Writing region close event to WAL at 1676153018707Closed at 1676153018707 2023-02-11 22:03:38,709 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:38,710 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153018709"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153018709"}]},"ts":"1676153018709"} 2023-02-11 22:03:38,712 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 22:03:38,713 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:38,713 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153018713"}]},"ts":"1676153018713"} 2023-02-11 22:03:38,714 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 22:03:38,717 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:38,717 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:38,717 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:38,717 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:38,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9d56d77650c9b6ce560336202ed7a4e9, ASSIGN}] 2023-02-11 22:03:38,724 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9d56d77650c9b6ce560336202ed7a4e9, ASSIGN 2023-02-11 22:03:38,725 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9d56d77650c9b6ce560336202ed7a4e9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45137,1676153018073; forceNewPlan=false, retain=false 2023-02-11 22:03:38,876 INFO [jenkins-hbase9:35513] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 22:03:38,877 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9d56d77650c9b6ce560336202ed7a4e9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:38,877 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153018877"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153018877"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153018877"}]},"ts":"1676153018877"} 2023-02-11 22:03:38,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9d56d77650c9b6ce560336202ed7a4e9, server=jenkins-hbase9.apache.org,45137,1676153018073}] 2023-02-11 22:03:39,034 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. 2023-02-11 22:03:39,036 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45137%2C1676153018073, suffix=, logDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/WALs/jenkins-hbase9.apache.org,45137,1676153018073, archiveDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/oldWALs, maxLogs=32 2023-02-11 22:03:39,050 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46197,DS-59c5e485-3ab9-4f56-9b69-ad8102c40d3b,DISK] 2023-02-11 22:03:39,051 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35187,DS-1f04d3e2-0a45-4c06-bef6-4c7b6ac886a8,DISK] 2023-02-11 22:03:39,052 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/WALs/jenkins-hbase9.apache.org,45137,1676153018073/jenkins-hbase9.apache.org%2C45137%2C1676153018073.1676153019036 2023-02-11 22:03:39,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35187,DS-1f04d3e2-0a45-4c06-bef6-4c7b6ac886a8,DISK], DatanodeInfoWithStorage[127.0.0.1:46197,DS-59c5e485-3ab9-4f56-9b69-ad8102c40d3b,DISK]] 2023-02-11 22:03:39,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9d56d77650c9b6ce560336202ed7a4e9, NAME => 'hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:39,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9d56d77650c9b6ce560336202ed7a4e9 2023-02-11 22:03:39,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 9d56d77650c9b6ce560336202ed7a4e9 2023-02-11 22:03:39,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 9d56d77650c9b6ce560336202ed7a4e9 2023-02-11 22:03:39,055 INFO [StoreOpener-9d56d77650c9b6ce560336202ed7a4e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9d56d77650c9b6ce560336202ed7a4e9 2023-02-11 22:03:39,056 DEBUG [StoreOpener-9d56d77650c9b6ce560336202ed7a4e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9/info 2023-02-11 22:03:39,056 DEBUG [StoreOpener-9d56d77650c9b6ce560336202ed7a4e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9/info 2023-02-11 22:03:39,056 INFO [StoreOpener-9d56d77650c9b6ce560336202ed7a4e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d56d77650c9b6ce560336202ed7a4e9 columnFamilyName info 2023-02-11 22:03:39,057 INFO [StoreOpener-9d56d77650c9b6ce560336202ed7a4e9-1] regionserver.HStore(310): Store=9d56d77650c9b6ce560336202ed7a4e9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,057 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9 2023-02-11 22:03:39,058 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9 2023-02-11 22:03:39,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 9d56d77650c9b6ce560336202ed7a4e9 2023-02-11 22:03:39,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:39,062 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 9d56d77650c9b6ce560336202ed7a4e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74887060, jitterRate=0.11590415239334106}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:39,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 9d56d77650c9b6ce560336202ed7a4e9: Running coprocessor pre-open hook at 1676153019053Writing region info on filesystem at 1676153019053Initializing all the Stores at 1676153019054 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153019054Cleaning up temporary data from old regions at 1676153019058 (+4 ms)Cleaning up detritus from prior splits at 1676153019058Running coprocessor post-open hooks at 1676153019062 (+4 ms)Region opened successfully at 1676153019062 2023-02-11 22:03:39,062 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9., pid=6, masterSystemTime=1676153019030 2023-02-11 22:03:39,065 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. 2023-02-11 22:03:39,065 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. 2023-02-11 22:03:39,065 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9d56d77650c9b6ce560336202ed7a4e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,065 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153019065"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153019065"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153019065"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153019065"}]},"ts":"1676153019065"} 2023-02-11 22:03:39,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 22:03:39,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9d56d77650c9b6ce560336202ed7a4e9, server=jenkins-hbase9.apache.org,45137,1676153018073 in 187 msec 2023-02-11 22:03:39,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 22:03:39,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9d56d77650c9b6ce560336202ed7a4e9, ASSIGN in 351 msec 2023-02-11 22:03:39,070 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:39,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153019070"}]},"ts":"1676153019070"} 2023-02-11 22:03:39,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 22:03:39,078 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 22:03:39,078 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:39,079 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:39,079 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:39,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 404 msec 2023-02-11 22:03:39,082 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 22:03:39,089 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:39,091 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-11 22:03:39,093 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 22:03:39,100 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:39,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-11 22:03:39,107 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 22:03:39,110 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 22:03:39,110 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.984sec 2023-02-11 22:03:39,110 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 22:03:39,110 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 22:03:39,110 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 22:03:39,110 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35513,1676153018018-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 22:03:39,110 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35513,1676153018018-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 22:03:39,111 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 22:03:39,122 DEBUG [Listener at localhost/43127] zookeeper.ReadOnlyZKClient(139): Connect 0x18878f29 to 127.0.0.1:58447 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:39,126 DEBUG [Listener at localhost/43127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d32b48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:39,128 DEBUG [hconnection-0x6359424b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:39,129 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:39,130 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,35513,1676153018018 2023-02-11 22:03:39,131 DEBUG [Listener at localhost/43127] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 22:03:39,133 DEBUG [Listener at localhost/43127] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 22:03:39,136 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58316, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 22:03:39,136 INFO [Listener at localhost/43127] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 22:03:39,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.2.10:58316 deadline: 1676153079136, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,137 INFO [Listener at localhost/43127] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-11 22:03:39,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:39,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,141 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:39,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-11 22:03:39,142 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:39,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:39,149 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:39,149 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:39,149 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:39,149 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c 2023-02-11 22:03:39,149 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:39,149 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:39,149 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:39,149 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:39,150 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d empty. 2023-02-11 22:03:39,153 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453 empty. 2023-02-11 22:03:39,153 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895 empty. 2023-02-11 22:03:39,153 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:39,153 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:39,153 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd empty. 2023-02-11 22:03:39,153 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131 empty. 2023-02-11 22:03:39,153 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b empty. 2023-02-11 22:03:39,154 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea empty. 2023-02-11 22:03:39,154 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c empty. 2023-02-11 22:03:39,154 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:39,154 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:39,154 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:39,154 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658 empty. 2023-02-11 22:03:39,154 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:39,154 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:39,154 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:39,155 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:39,155 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c 2023-02-11 22:03:39,155 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f empty. 2023-02-11 22:03:39,155 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:39,155 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:39,155 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-11 22:03:39,165 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:39,167 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => c77a08c8939c5654bd5d2cdec1784dea, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp 2023-02-11 22:03:39,167 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => dd258983e5ed209f80e2edb232c68895, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp 2023-02-11 22:03:39,167 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => ad58de138d24248fca2e889393c1191d, NAME => 'testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp 2023-02-11 22:03:39,182 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,182 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing c77a08c8939c5654bd5d2cdec1784dea, disabling compactions & flushes 2023-02-11 22:03:39,182 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:39,182 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:39,182 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. after waiting 0 ms 2023-02-11 22:03:39,182 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:39,182 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:39,182 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for c77a08c8939c5654bd5d2cdec1784dea: Waiting for close lock at 1676153019182Disabling compacts and flushes for region at 1676153019182Disabling writes for close at 1676153019182Writing region close event to WAL at 1676153019182Closed at 1676153019182 2023-02-11 22:03:39,183 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => bc6dde637206fbcdc9221e940ba4c453, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp 2023-02-11 22:03:39,183 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,183 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing dd258983e5ed209f80e2edb232c68895, disabling compactions & flushes 2023-02-11 22:03:39,184 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:39,184 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:39,184 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. after waiting 0 ms 2023-02-11 22:03:39,184 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:39,184 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:39,184 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for dd258983e5ed209f80e2edb232c68895: Waiting for close lock at 1676153019183Disabling compacts and flushes for region at 1676153019183Disabling writes for close at 1676153019184 (+1 ms)Writing region close event to WAL at 1676153019184Closed at 1676153019184 2023-02-11 22:03:39,184 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5174517129e32184c95d75c89c87312c, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp 2023-02-11 22:03:39,187 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,188 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing ad58de138d24248fca2e889393c1191d, disabling compactions & flushes 2023-02-11 22:03:39,188 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:39,188 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:39,188 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. after waiting 0 ms 2023-02-11 22:03:39,188 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:39,188 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:39,188 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for ad58de138d24248fca2e889393c1191d: Waiting for close lock at 1676153019188Disabling compacts and flushes for region at 1676153019188Disabling writes for close at 1676153019188Writing region close event to WAL at 1676153019188Closed at 1676153019188 2023-02-11 22:03:39,188 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 02600f2e0b4f2b3f77cf9f34dcd31cdd, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp 2023-02-11 22:03:39,197 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,197 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing bc6dde637206fbcdc9221e940ba4c453, disabling compactions & flushes 2023-02-11 22:03:39,197 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:39,198 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:39,198 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. after waiting 0 ms 2023-02-11 22:03:39,198 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:39,198 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:39,198 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for bc6dde637206fbcdc9221e940ba4c453: Waiting for close lock at 1676153019197Disabling compacts and flushes for region at 1676153019197Disabling writes for close at 1676153019198 (+1 ms)Writing region close event to WAL at 1676153019198Closed at 1676153019198 2023-02-11 22:03:39,198 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5d4b5ec17541030a2731619cc0c22131, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp 2023-02-11 22:03:39,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 5174517129e32184c95d75c89c87312c, disabling compactions & flushes 2023-02-11 22:03:39,200 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:39,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:39,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. after waiting 0 ms 2023-02-11 22:03:39,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:39,200 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:39,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 5174517129e32184c95d75c89c87312c: Waiting for close lock at 1676153019200Disabling compacts and flushes for region at 1676153019200Disabling writes for close at 1676153019200Writing region close event to WAL at 1676153019200Closed at 1676153019200 2023-02-11 22:03:39,201 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7ba50bc234474d8b78783b91ee87273b, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp 2023-02-11 22:03:39,203 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,203 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 02600f2e0b4f2b3f77cf9f34dcd31cdd, disabling compactions & flushes 2023-02-11 22:03:39,203 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:39,203 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:39,203 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. after waiting 0 ms 2023-02-11 22:03:39,203 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:39,203 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:39,203 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 02600f2e0b4f2b3f77cf9f34dcd31cdd: Waiting for close lock at 1676153019203Disabling compacts and flushes for region at 1676153019203Disabling writes for close at 1676153019203Writing region close event to WAL at 1676153019203Closed at 1676153019203 2023-02-11 22:03:39,204 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4c6bba163d882e30ed97ad7704071658, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp 2023-02-11 22:03:39,207 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,208 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 5d4b5ec17541030a2731619cc0c22131, disabling compactions & flushes 2023-02-11 22:03:39,208 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:39,208 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:39,208 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. after waiting 0 ms 2023-02-11 22:03:39,208 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:39,208 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:39,208 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 5d4b5ec17541030a2731619cc0c22131: Waiting for close lock at 1676153019208Disabling compacts and flushes for region at 1676153019208Disabling writes for close at 1676153019208Writing region close event to WAL at 1676153019208Closed at 1676153019208 2023-02-11 22:03:39,208 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2b81c83bbc762e01c0d4687ecc3e4d5f, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp 2023-02-11 22:03:39,211 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,211 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 7ba50bc234474d8b78783b91ee87273b, disabling compactions & flushes 2023-02-11 22:03:39,211 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:39,211 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:39,211 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. after waiting 0 ms 2023-02-11 22:03:39,211 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,211 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:39,211 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 4c6bba163d882e30ed97ad7704071658, disabling compactions & flushes 2023-02-11 22:03:39,211 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:39,211 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:39,211 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 7ba50bc234474d8b78783b91ee87273b: Waiting for close lock at 1676153019211Disabling compacts and flushes for region at 1676153019211Disabling writes for close at 1676153019211Writing region close event to WAL at 1676153019211Closed at 1676153019211 2023-02-11 22:03:39,211 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:39,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. after waiting 0 ms 2023-02-11 22:03:39,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:39,212 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:39,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 4c6bba163d882e30ed97ad7704071658: Waiting for close lock at 1676153019211Disabling compacts and flushes for region at 1676153019211Disabling writes for close at 1676153019212 (+1 ms)Writing region close event to WAL at 1676153019212Closed at 1676153019212 2023-02-11 22:03:39,214 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,215 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 2b81c83bbc762e01c0d4687ecc3e4d5f, disabling compactions & flushes 2023-02-11 22:03:39,215 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:39,215 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:39,215 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. after waiting 0 ms 2023-02-11 22:03:39,215 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:39,215 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:39,215 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 2b81c83bbc762e01c0d4687ecc3e4d5f: Waiting for close lock at 1676153019215Disabling compacts and flushes for region at 1676153019215Disabling writes for close at 1676153019215Writing region close event to WAL at 1676153019215Closed at 1676153019215 2023-02-11 22:03:39,217 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:39,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153019218"}]},"ts":"1676153019218"} 2023-02-11 22:03:39,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153019218"}]},"ts":"1676153019218"} 2023-02-11 22:03:39,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676153019218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153019218"}]},"ts":"1676153019218"} 2023-02-11 22:03:39,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153019218"}]},"ts":"1676153019218"} 2023-02-11 22:03:39,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676153019139.5174517129e32184c95d75c89c87312c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153019218"}]},"ts":"1676153019218"} 2023-02-11 22:03:39,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153019218"}]},"ts":"1676153019218"} 2023-02-11 22:03:39,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153019218"}]},"ts":"1676153019218"} 2023-02-11 22:03:39,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153019218"}]},"ts":"1676153019218"} 2023-02-11 22:03:39,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153019218"}]},"ts":"1676153019218"} 2023-02-11 22:03:39,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676153019218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153019218"}]},"ts":"1676153019218"} 2023-02-11 22:03:39,220 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-11 22:03:39,221 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:39,221 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153019221"}]},"ts":"1676153019221"} 2023-02-11 22:03:39,222 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-11 22:03:39,226 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:39,231 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:39,231 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:39,231 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:39,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad58de138d24248fca2e889393c1191d, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=dd258983e5ed209f80e2edb232c68895, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c77a08c8939c5654bd5d2cdec1784dea, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc6dde637206fbcdc9221e940ba4c453, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5174517129e32184c95d75c89c87312c, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02600f2e0b4f2b3f77cf9f34dcd31cdd, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d4b5ec17541030a2731619cc0c22131, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ba50bc234474d8b78783b91ee87273b, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4c6bba163d882e30ed97ad7704071658, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2b81c83bbc762e01c0d4687ecc3e4d5f, ASSIGN}] 2023-02-11 22:03:39,233 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=dd258983e5ed209f80e2edb232c68895, ASSIGN 2023-02-11 22:03:39,234 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad58de138d24248fca2e889393c1191d, ASSIGN 2023-02-11 22:03:39,234 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2b81c83bbc762e01c0d4687ecc3e4d5f, ASSIGN 2023-02-11 22:03:39,234 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4c6bba163d882e30ed97ad7704071658, ASSIGN 2023-02-11 22:03:39,234 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ba50bc234474d8b78783b91ee87273b, ASSIGN 2023-02-11 22:03:39,234 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2b81c83bbc762e01c0d4687ecc3e4d5f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45137,1676153018073; forceNewPlan=false, retain=false 2023-02-11 22:03:39,234 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad58de138d24248fca2e889393c1191d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35641,1676153018101; forceNewPlan=false, retain=false 2023-02-11 22:03:39,234 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4c6bba163d882e30ed97ad7704071658, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35641,1676153018101; forceNewPlan=false, retain=false 2023-02-11 22:03:39,234 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=dd258983e5ed209f80e2edb232c68895, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45137,1676153018073; forceNewPlan=false, retain=false 2023-02-11 22:03:39,235 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ba50bc234474d8b78783b91ee87273b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45137,1676153018073; forceNewPlan=false, retain=false 2023-02-11 22:03:39,236 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d4b5ec17541030a2731619cc0c22131, ASSIGN 2023-02-11 22:03:39,236 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02600f2e0b4f2b3f77cf9f34dcd31cdd, ASSIGN 2023-02-11 22:03:39,236 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5174517129e32184c95d75c89c87312c, ASSIGN 2023-02-11 22:03:39,236 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc6dde637206fbcdc9221e940ba4c453, ASSIGN 2023-02-11 22:03:39,236 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c77a08c8939c5654bd5d2cdec1784dea, ASSIGN 2023-02-11 22:03:39,236 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d4b5ec17541030a2731619cc0c22131, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35641,1676153018101; forceNewPlan=false, retain=false 2023-02-11 22:03:39,237 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02600f2e0b4f2b3f77cf9f34dcd31cdd, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45137,1676153018073; forceNewPlan=false, retain=false 2023-02-11 22:03:39,237 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5174517129e32184c95d75c89c87312c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35641,1676153018101; forceNewPlan=false, retain=false 2023-02-11 22:03:39,237 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc6dde637206fbcdc9221e940ba4c453, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45137,1676153018073; forceNewPlan=false, retain=false 2023-02-11 22:03:39,237 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c77a08c8939c5654bd5d2cdec1784dea, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35641,1676153018101; forceNewPlan=false, retain=false 2023-02-11 22:03:39,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:39,362 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 22:03:39,424 INFO [jenkins-hbase9:35513] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-11 22:03:39,433 INFO [RS:1;jenkins-hbase9:35641] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35641%2C1676153018101, suffix=, logDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/WALs/jenkins-hbase9.apache.org,35641,1676153018101, archiveDir=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/oldWALs, maxLogs=32 2023-02-11 22:03:39,445 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=02600f2e0b4f2b3f77cf9f34dcd31cdd, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,446 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2b81c83bbc762e01c0d4687ecc3e4d5f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,446 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676153019446"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153019446"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153019446"}]},"ts":"1676153019446"} 2023-02-11 22:03:39,445 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=dd258983e5ed209f80e2edb232c68895, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,447 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=bc6dde637206fbcdc9221e940ba4c453, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,447 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019445"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153019445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153019445"}]},"ts":"1676153019445"} 2023-02-11 22:03:39,447 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019447"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153019447"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153019447"}]},"ts":"1676153019447"} 2023-02-11 22:03:39,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:39,445 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=7ba50bc234474d8b78783b91ee87273b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,446 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019445"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153019445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153019445"}]},"ts":"1676153019445"} 2023-02-11 22:03:39,448 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019445"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153019445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153019445"}]},"ts":"1676153019445"} 2023-02-11 22:03:39,449 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 2b81c83bbc762e01c0d4687ecc3e4d5f, server=jenkins-hbase9.apache.org,45137,1676153018073}] 2023-02-11 22:03:39,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure dd258983e5ed209f80e2edb232c68895, server=jenkins-hbase9.apache.org,45137,1676153018073}] 2023-02-11 22:03:39,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=14, state=RUNNABLE; OpenRegionProcedure bc6dde637206fbcdc9221e940ba4c453, server=jenkins-hbase9.apache.org,45137,1676153018073}] 2023-02-11 22:03:39,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 02600f2e0b4f2b3f77cf9f34dcd31cdd, server=jenkins-hbase9.apache.org,45137,1676153018073}] 2023-02-11 22:03:39,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=18, state=RUNNABLE; OpenRegionProcedure 7ba50bc234474d8b78783b91ee87273b, server=jenkins-hbase9.apache.org,45137,1676153018073}] 2023-02-11 22:03:39,454 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=5d4b5ec17541030a2731619cc0c22131, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,454 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019454"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153019454"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153019454"}]},"ts":"1676153019454"} 2023-02-11 22:03:39,455 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c77a08c8939c5654bd5d2cdec1784dea, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,455 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153019455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153019455"}]},"ts":"1676153019455"} 2023-02-11 22:03:39,455 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5174517129e32184c95d75c89c87312c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,456 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676153019139.5174517129e32184c95d75c89c87312c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153019455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153019455"}]},"ts":"1676153019455"} 2023-02-11 22:03:39,457 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ad58de138d24248fca2e889393c1191d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,457 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676153019457"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153019457"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153019457"}]},"ts":"1676153019457"} 2023-02-11 22:03:39,458 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure 5d4b5ec17541030a2731619cc0c22131, server=jenkins-hbase9.apache.org,35641,1676153018101}] 2023-02-11 22:03:39,458 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4c6bba163d882e30ed97ad7704071658, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,458 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019458"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153019458"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153019458"}]},"ts":"1676153019458"} 2023-02-11 22:03:39,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=13, state=RUNNABLE; OpenRegionProcedure c77a08c8939c5654bd5d2cdec1784dea, server=jenkins-hbase9.apache.org,35641,1676153018101}] 2023-02-11 22:03:39,464 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35187,DS-1f04d3e2-0a45-4c06-bef6-4c7b6ac886a8,DISK] 2023-02-11 22:03:39,464 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46197,DS-59c5e485-3ab9-4f56-9b69-ad8102c40d3b,DISK] 2023-02-11 22:03:39,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=15, state=RUNNABLE; OpenRegionProcedure 5174517129e32184c95d75c89c87312c, server=jenkins-hbase9.apache.org,35641,1676153018101}] 2023-02-11 22:03:39,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=11, state=RUNNABLE; OpenRegionProcedure ad58de138d24248fca2e889393c1191d, server=jenkins-hbase9.apache.org,35641,1676153018101}] 2023-02-11 22:03:39,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=19, state=RUNNABLE; OpenRegionProcedure 4c6bba163d882e30ed97ad7704071658, server=jenkins-hbase9.apache.org,35641,1676153018101}] 2023-02-11 22:03:39,473 INFO [RS:1;jenkins-hbase9:35641] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/WALs/jenkins-hbase9.apache.org,35641,1676153018101/jenkins-hbase9.apache.org%2C35641%2C1676153018101.1676153019434 2023-02-11 22:03:39,473 DEBUG [RS:1;jenkins-hbase9:35641] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35187,DS-1f04d3e2-0a45-4c06-bef6-4c7b6ac886a8,DISK], DatanodeInfoWithStorage[127.0.0.1:46197,DS-59c5e485-3ab9-4f56-9b69-ad8102c40d3b,DISK]] 2023-02-11 22:03:39,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:39,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2b81c83bbc762e01c0d4687ecc3e4d5f, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-11 22:03:39,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:39,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:39,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:39,607 INFO [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:39,608 DEBUG [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/f1 2023-02-11 22:03:39,608 DEBUG [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/f1 2023-02-11 22:03:39,609 INFO [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b81c83bbc762e01c0d4687ecc3e4d5f columnFamilyName f1 2023-02-11 22:03:39,609 INFO [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] regionserver.HStore(310): Store=2b81c83bbc762e01c0d4687ecc3e4d5f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,609 INFO [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:39,610 DEBUG [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/f2 2023-02-11 22:03:39,610 DEBUG [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/f2 2023-02-11 22:03:39,611 INFO [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b81c83bbc762e01c0d4687ecc3e4d5f columnFamilyName f2 2023-02-11 22:03:39,611 INFO [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] regionserver.HStore(310): Store=2b81c83bbc762e01c0d4687ecc3e4d5f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:39,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:39,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:39,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:39,615 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,616 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 22:03:39,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:39,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 2b81c83bbc762e01c0d4687ecc3e4d5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72754591, jitterRate=0.08412788808345795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:39,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 2b81c83bbc762e01c0d4687ecc3e4d5f: Running coprocessor pre-open hook at 1676153019606Writing region info on filesystem at 1676153019606Initializing all the Stores at 1676153019607 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019607Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019607Cleaning up temporary data from old regions at 1676153019612 (+5 ms)Cleaning up detritus from prior splits at 1676153019613 (+1 ms)Running coprocessor post-open hooks at 1676153019616 (+3 ms)Region opened successfully at 1676153019616 2023-02-11 22:03:39,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f., pid=21, masterSystemTime=1676153019602 2023-02-11 22:03:39,617 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49552, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 22:03:39,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:39,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:39,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:39,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bc6dde637206fbcdc9221e940ba4c453, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-11 22:03:39,619 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2b81c83bbc762e01c0d4687ecc3e4d5f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:39,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:39,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:39,619 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676153019619"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153019619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153019619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153019619"}]},"ts":"1676153019619"} 2023-02-11 22:03:39,620 INFO [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:39,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:39,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c77a08c8939c5654bd5d2cdec1784dea, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-11 22:03:39,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:39,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:39,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:39,621 DEBUG [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1 2023-02-11 22:03:39,622 DEBUG [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1 2023-02-11 22:03:39,622 INFO [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc6dde637206fbcdc9221e940ba4c453 columnFamilyName f1 2023-02-11 22:03:39,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-11 22:03:39,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 2b81c83bbc762e01c0d4687ecc3e4d5f, server=jenkins-hbase9.apache.org,45137,1676153018073 in 172 msec 2023-02-11 22:03:39,622 INFO [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:39,622 INFO [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] regionserver.HStore(310): Store=bc6dde637206fbcdc9221e940ba4c453/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,622 INFO [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:39,623 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2b81c83bbc762e01c0d4687ecc3e4d5f, ASSIGN in 390 msec 2023-02-11 22:03:39,623 DEBUG [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2 2023-02-11 22:03:39,623 DEBUG [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2 2023-02-11 22:03:39,623 DEBUG [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1 2023-02-11 22:03:39,623 DEBUG [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1 2023-02-11 22:03:39,624 INFO [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc6dde637206fbcdc9221e940ba4c453 columnFamilyName f2 2023-02-11 22:03:39,624 INFO [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c77a08c8939c5654bd5d2cdec1784dea columnFamilyName f1 2023-02-11 22:03:39,624 INFO [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] regionserver.HStore(310): Store=bc6dde637206fbcdc9221e940ba4c453/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,624 INFO [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] regionserver.HStore(310): Store=c77a08c8939c5654bd5d2cdec1784dea/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,624 INFO [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:39,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:39,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:39,625 DEBUG [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2 2023-02-11 22:03:39,625 DEBUG [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2 2023-02-11 22:03:39,626 INFO [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c77a08c8939c5654bd5d2cdec1784dea columnFamilyName f2 2023-02-11 22:03:39,626 INFO [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] regionserver.HStore(310): Store=c77a08c8939c5654bd5d2cdec1784dea/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:39,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:39,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:39,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:39,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:39,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:39,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened bc6dde637206fbcdc9221e940ba4c453; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69592669, jitterRate=0.03701157867908478}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:39,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:39,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for bc6dde637206fbcdc9221e940ba4c453: Running coprocessor pre-open hook at 1676153019619Writing region info on filesystem at 1676153019619Initializing all the Stores at 1676153019620 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019620Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019620Cleaning up temporary data from old regions at 1676153019626 (+6 ms)Cleaning up detritus from prior splits at 1676153019626Running coprocessor post-open hooks at 1676153019630 (+4 ms)Region opened successfully at 1676153019630 2023-02-11 22:03:39,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453., pid=23, masterSystemTime=1676153019602 2023-02-11 22:03:39,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:39,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:39,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:39,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:39,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 02600f2e0b4f2b3f77cf9f34dcd31cdd, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-11 22:03:39,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened c77a08c8939c5654bd5d2cdec1784dea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75062911, jitterRate=0.11852453649044037}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:39,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:39,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for c77a08c8939c5654bd5d2cdec1784dea: Running coprocessor pre-open hook at 1676153019621Writing region info on filesystem at 1676153019621Initializing all the Stores at 1676153019622 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019622Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019622Cleaning up temporary data from old regions at 1676153019628 (+6 ms)Cleaning up detritus from prior splits at 1676153019628Running coprocessor post-open hooks at 1676153019632 (+4 ms)Region opened successfully at 1676153019632 2023-02-11 22:03:39,632 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=bc6dde637206fbcdc9221e940ba4c453, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:39,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:39,632 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019632"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153019632"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153019632"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153019632"}]},"ts":"1676153019632"} 2023-02-11 22:03:39,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea., pid=27, masterSystemTime=1676153019615 2023-02-11 22:03:39,635 INFO [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:39,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:39,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:39,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:39,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ad58de138d24248fca2e889393c1191d, NAME => 'testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-11 22:03:39,636 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c77a08c8939c5654bd5d2cdec1784dea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,636 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019636"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153019636"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153019636"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153019636"}]},"ts":"1676153019636"} 2023-02-11 22:03:39,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:39,637 DEBUG [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1 2023-02-11 22:03:39,637 DEBUG [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1 2023-02-11 22:03:39,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:39,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:39,637 INFO [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02600f2e0b4f2b3f77cf9f34dcd31cdd columnFamilyName f1 2023-02-11 22:03:39,637 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=14 2023-02-11 22:03:39,637 INFO [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] regionserver.HStore(310): Store=02600f2e0b4f2b3f77cf9f34dcd31cdd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=14, state=SUCCESS; OpenRegionProcedure bc6dde637206fbcdc9221e940ba4c453, server=jenkins-hbase9.apache.org,45137,1676153018073 in 184 msec 2023-02-11 22:03:39,638 INFO [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:39,638 INFO [StoreOpener-ad58de138d24248fca2e889393c1191d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:39,639 DEBUG [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2 2023-02-11 22:03:39,639 DEBUG [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2 2023-02-11 22:03:39,639 INFO [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02600f2e0b4f2b3f77cf9f34dcd31cdd columnFamilyName f2 2023-02-11 22:03:39,639 DEBUG [StoreOpener-ad58de138d24248fca2e889393c1191d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/f1 2023-02-11 22:03:39,639 DEBUG [StoreOpener-ad58de138d24248fca2e889393c1191d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/f1 2023-02-11 22:03:39,639 INFO [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] regionserver.HStore(310): Store=02600f2e0b4f2b3f77cf9f34dcd31cdd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,639 INFO [StoreOpener-ad58de138d24248fca2e889393c1191d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad58de138d24248fca2e889393c1191d columnFamilyName f1 2023-02-11 22:03:39,640 INFO [StoreOpener-ad58de138d24248fca2e889393c1191d-1] regionserver.HStore(310): Store=ad58de138d24248fca2e889393c1191d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc6dde637206fbcdc9221e940ba4c453, ASSIGN in 406 msec 2023-02-11 22:03:39,640 INFO [StoreOpener-ad58de138d24248fca2e889393c1191d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:39,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:39,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=13 2023-02-11 22:03:39,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=13, state=SUCCESS; OpenRegionProcedure c77a08c8939c5654bd5d2cdec1784dea, server=jenkins-hbase9.apache.org,35641,1676153018101 in 179 msec 2023-02-11 22:03:39,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:39,641 DEBUG [StoreOpener-ad58de138d24248fca2e889393c1191d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/f2 2023-02-11 22:03:39,641 DEBUG [StoreOpener-ad58de138d24248fca2e889393c1191d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/f2 2023-02-11 22:03:39,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c77a08c8939c5654bd5d2cdec1784dea, ASSIGN in 408 msec 2023-02-11 22:03:39,642 INFO [StoreOpener-ad58de138d24248fca2e889393c1191d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad58de138d24248fca2e889393c1191d columnFamilyName f2 2023-02-11 22:03:39,642 INFO [StoreOpener-ad58de138d24248fca2e889393c1191d-1] regionserver.HStore(310): Store=ad58de138d24248fca2e889393c1191d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:39,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:39,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:39,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:39,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:39,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:39,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 02600f2e0b4f2b3f77cf9f34dcd31cdd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60615253, jitterRate=-0.09676234424114227}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:39,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 02600f2e0b4f2b3f77cf9f34dcd31cdd: Running coprocessor pre-open hook at 1676153019632Writing region info on filesystem at 1676153019632Initializing all the Stores at 1676153019634 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019634Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019635 (+1 ms)Cleaning up temporary data from old regions at 1676153019641 (+6 ms)Cleaning up detritus from prior splits at 1676153019642 (+1 ms)Running coprocessor post-open hooks at 1676153019645 (+3 ms)Region opened successfully at 1676153019645 2023-02-11 22:03:39,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:39,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd., pid=24, masterSystemTime=1676153019602 2023-02-11 22:03:39,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:39,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:39,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:39,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:39,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened ad58de138d24248fca2e889393c1191d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74288844, jitterRate=0.1069900393486023}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:39,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7ba50bc234474d8b78783b91ee87273b, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-11 22:03:39,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for ad58de138d24248fca2e889393c1191d: Running coprocessor pre-open hook at 1676153019637Writing region info on filesystem at 1676153019637Initializing all the Stores at 1676153019638 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019638Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019638Cleaning up temporary data from old regions at 1676153019643 (+5 ms)Cleaning up detritus from prior splits at 1676153019644 (+1 ms)Running coprocessor post-open hooks at 1676153019647 (+3 ms)Region opened successfully at 1676153019647 2023-02-11 22:03:39,647 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=02600f2e0b4f2b3f77cf9f34dcd31cdd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:39,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,647 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019647"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153019647"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153019647"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153019647"}]},"ts":"1676153019647"} 2023-02-11 22:03:39,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:39,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:39,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d., pid=29, masterSystemTime=1676153019615 2023-02-11 22:03:39,649 INFO [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:39,650 DEBUG [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1 2023-02-11 22:03:39,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:39,650 DEBUG [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1 2023-02-11 22:03:39,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:39,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:39,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4c6bba163d882e30ed97ad7704071658, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-11 22:03:39,650 INFO [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ba50bc234474d8b78783b91ee87273b columnFamilyName f1 2023-02-11 22:03:39,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:39,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,651 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ad58de138d24248fca2e889393c1191d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:39,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:39,651 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676153019651"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153019651"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153019651"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153019651"}]},"ts":"1676153019651"} 2023-02-11 22:03:39,651 INFO [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] regionserver.HStore(310): Store=7ba50bc234474d8b78783b91ee87273b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,651 INFO [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:39,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-11 22:03:39,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 02600f2e0b4f2b3f77cf9f34dcd31cdd, server=jenkins-hbase9.apache.org,45137,1676153018073 in 197 msec 2023-02-11 22:03:39,652 INFO [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:39,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02600f2e0b4f2b3f77cf9f34dcd31cdd, ASSIGN in 420 msec 2023-02-11 22:03:39,653 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=11 2023-02-11 22:03:39,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=11, state=SUCCESS; OpenRegionProcedure ad58de138d24248fca2e889393c1191d, server=jenkins-hbase9.apache.org,35641,1676153018101 in 185 msec 2023-02-11 22:03:39,654 DEBUG [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1 2023-02-11 22:03:39,654 DEBUG [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1 2023-02-11 22:03:39,654 INFO [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c6bba163d882e30ed97ad7704071658 columnFamilyName f1 2023-02-11 22:03:39,654 INFO [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] regionserver.HStore(310): Store=4c6bba163d882e30ed97ad7704071658/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad58de138d24248fca2e889393c1191d, ASSIGN in 422 msec 2023-02-11 22:03:39,655 INFO [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:39,655 DEBUG [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2 2023-02-11 22:03:39,655 DEBUG [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2 2023-02-11 22:03:39,655 INFO [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ba50bc234474d8b78783b91ee87273b columnFamilyName f2 2023-02-11 22:03:39,656 INFO [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] regionserver.HStore(310): Store=7ba50bc234474d8b78783b91ee87273b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,656 DEBUG [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2 2023-02-11 22:03:39,656 DEBUG [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2 2023-02-11 22:03:39,656 INFO [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c6bba163d882e30ed97ad7704071658 columnFamilyName f2 2023-02-11 22:03:39,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:39,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:39,657 INFO [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] regionserver.HStore(310): Store=4c6bba163d882e30ed97ad7704071658/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:39,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:39,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:39,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:39,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:39,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:39,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:39,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 7ba50bc234474d8b78783b91ee87273b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74841500, jitterRate=0.11522525548934937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:39,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 7ba50bc234474d8b78783b91ee87273b: Running coprocessor pre-open hook at 1676153019648Writing region info on filesystem at 1676153019648Initializing all the Stores at 1676153019648Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019648Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019649 (+1 ms)Cleaning up temporary data from old regions at 1676153019658 (+9 ms)Cleaning up detritus from prior splits at 1676153019658Running coprocessor post-open hooks at 1676153019662 (+4 ms)Region opened successfully at 1676153019662 2023-02-11 22:03:39,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:39,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b., pid=25, masterSystemTime=1676153019602 2023-02-11 22:03:39,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 4c6bba163d882e30ed97ad7704071658; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73963158, jitterRate=0.10213693976402283}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:39,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 4c6bba163d882e30ed97ad7704071658: Running coprocessor pre-open hook at 1676153019651Writing region info on filesystem at 1676153019651Initializing all the Stores at 1676153019652 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019652Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019652Cleaning up temporary data from old regions at 1676153019658 (+6 ms)Cleaning up detritus from prior splits at 1676153019659 (+1 ms)Running coprocessor post-open hooks at 1676153019663 (+4 ms)Region opened successfully at 1676153019663 2023-02-11 22:03:39,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658., pid=30, masterSystemTime=1676153019615 2023-02-11 22:03:39,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:39,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:39,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:39,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dd258983e5ed209f80e2edb232c68895, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-11 22:03:39,664 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=7ba50bc234474d8b78783b91ee87273b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,664 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019664"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153019664"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153019664"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153019664"}]},"ts":"1676153019664"} 2023-02-11 22:03:39,665 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4c6bba163d882e30ed97ad7704071658, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,665 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019665"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153019665"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153019665"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153019665"}]},"ts":"1676153019665"} 2023-02-11 22:03:39,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:39,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:39,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:39,668 INFO [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:39,669 DEBUG [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1 2023-02-11 22:03:39,669 DEBUG [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1 2023-02-11 22:03:39,670 INFO [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd258983e5ed209f80e2edb232c68895 columnFamilyName f1 2023-02-11 22:03:39,670 INFO [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] regionserver.HStore(310): Store=dd258983e5ed209f80e2edb232c68895/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,670 INFO [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:39,671 DEBUG [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2 2023-02-11 22:03:39,671 DEBUG [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2 2023-02-11 22:03:39,672 INFO [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd258983e5ed209f80e2edb232c68895 columnFamilyName f2 2023-02-11 22:03:39,672 INFO [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] regionserver.HStore(310): Store=dd258983e5ed209f80e2edb232c68895/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:39,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:39,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:39,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:39,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:39,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:39,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5174517129e32184c95d75c89c87312c, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-11 22:03:39,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5174517129e32184c95d75c89c87312c 2023-02-11 22:03:39,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 5174517129e32184c95d75c89c87312c 2023-02-11 22:03:39,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 5174517129e32184c95d75c89c87312c 2023-02-11 22:03:39,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:39,677 INFO [StoreOpener-5174517129e32184c95d75c89c87312c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5174517129e32184c95d75c89c87312c 2023-02-11 22:03:39,679 DEBUG [StoreOpener-5174517129e32184c95d75c89c87312c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1 2023-02-11 22:03:39,679 DEBUG [StoreOpener-5174517129e32184c95d75c89c87312c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1 2023-02-11 22:03:39,679 INFO [StoreOpener-5174517129e32184c95d75c89c87312c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5174517129e32184c95d75c89c87312c columnFamilyName f1 2023-02-11 22:03:39,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=19 2023-02-11 22:03:39,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=19, state=SUCCESS; OpenRegionProcedure 4c6bba163d882e30ed97ad7704071658, server=jenkins-hbase9.apache.org,35641,1676153018101 in 205 msec 2023-02-11 22:03:39,680 INFO [StoreOpener-5174517129e32184c95d75c89c87312c-1] regionserver.HStore(310): Store=5174517129e32184c95d75c89c87312c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,680 INFO [StoreOpener-5174517129e32184c95d75c89c87312c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5174517129e32184c95d75c89c87312c 2023-02-11 22:03:39,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=18 2023-02-11 22:03:39,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=18, state=SUCCESS; OpenRegionProcedure 7ba50bc234474d8b78783b91ee87273b, server=jenkins-hbase9.apache.org,45137,1676153018073 in 223 msec 2023-02-11 22:03:39,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4c6bba163d882e30ed97ad7704071658, ASSIGN in 448 msec 2023-02-11 22:03:39,681 DEBUG [StoreOpener-5174517129e32184c95d75c89c87312c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2 2023-02-11 22:03:39,681 DEBUG [StoreOpener-5174517129e32184c95d75c89c87312c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2 2023-02-11 22:03:39,682 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ba50bc234474d8b78783b91ee87273b, ASSIGN in 448 msec 2023-02-11 22:03:39,682 INFO [StoreOpener-5174517129e32184c95d75c89c87312c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5174517129e32184c95d75c89c87312c columnFamilyName f2 2023-02-11 22:03:39,682 INFO [StoreOpener-5174517129e32184c95d75c89c87312c-1] regionserver.HStore(310): Store=5174517129e32184c95d75c89c87312c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:39,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c 2023-02-11 22:03:39,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c 2023-02-11 22:03:39,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened dd258983e5ed209f80e2edb232c68895; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60780379, jitterRate=-0.09430177509784698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:39,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for dd258983e5ed209f80e2edb232c68895: Running coprocessor pre-open hook at 1676153019667Writing region info on filesystem at 1676153019667Initializing all the Stores at 1676153019668 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019668Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019668Cleaning up temporary data from old regions at 1676153019674 (+6 ms)Cleaning up detritus from prior splits at 1676153019674Running coprocessor post-open hooks at 1676153019683 (+9 ms)Region opened successfully at 1676153019683 2023-02-11 22:03:39,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895., pid=22, masterSystemTime=1676153019602 2023-02-11 22:03:39,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:39,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:39,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:39,685 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=dd258983e5ed209f80e2edb232c68895, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,686 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019685"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153019685"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153019685"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153019685"}]},"ts":"1676153019685"} 2023-02-11 22:03:39,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 5174517129e32184c95d75c89c87312c 2023-02-11 22:03:39,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-11 22:03:39,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:39,689 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure dd258983e5ed209f80e2edb232c68895, server=jenkins-hbase9.apache.org,45137,1676153018073 in 237 msec 2023-02-11 22:03:39,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 5174517129e32184c95d75c89c87312c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71751587, jitterRate=0.06918196380138397}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:39,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 5174517129e32184c95d75c89c87312c: Running coprocessor pre-open hook at 1676153019675Writing region info on filesystem at 1676153019675Initializing all the Stores at 1676153019677 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019677Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019677Cleaning up temporary data from old regions at 1676153019684 (+7 ms)Cleaning up detritus from prior splits at 1676153019684Running coprocessor post-open hooks at 1676153019689 (+5 ms)Region opened successfully at 1676153019689 2023-02-11 22:03:39,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c., pid=28, masterSystemTime=1676153019615 2023-02-11 22:03:39,690 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=dd258983e5ed209f80e2edb232c68895, ASSIGN in 456 msec 2023-02-11 22:03:39,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:39,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:39,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:39,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5d4b5ec17541030a2731619cc0c22131, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-11 22:03:39,691 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5174517129e32184c95d75c89c87312c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:39,691 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676153019139.5174517129e32184c95d75c89c87312c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019691"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153019691"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153019691"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153019691"}]},"ts":"1676153019691"} 2023-02-11 22:03:39,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:39,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:39,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:39,692 INFO [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:39,694 DEBUG [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1 2023-02-11 22:03:39,694 DEBUG [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1 2023-02-11 22:03:39,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=15 2023-02-11 22:03:39,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=15, state=SUCCESS; OpenRegionProcedure 5174517129e32184c95d75c89c87312c, server=jenkins-hbase9.apache.org,35641,1676153018101 in 226 msec 2023-02-11 22:03:39,694 INFO [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d4b5ec17541030a2731619cc0c22131 columnFamilyName f1 2023-02-11 22:03:39,694 INFO [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] regionserver.HStore(310): Store=5d4b5ec17541030a2731619cc0c22131/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,694 INFO [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:39,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5174517129e32184c95d75c89c87312c, ASSIGN in 462 msec 2023-02-11 22:03:39,695 DEBUG [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2 2023-02-11 22:03:39,695 DEBUG [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2 2023-02-11 22:03:39,696 INFO [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d4b5ec17541030a2731619cc0c22131 columnFamilyName f2 2023-02-11 22:03:39,696 INFO [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] regionserver.HStore(310): Store=5d4b5ec17541030a2731619cc0c22131/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:39,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:39,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:39,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:39,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:39,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:39,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 5d4b5ec17541030a2731619cc0c22131; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62776205, jitterRate=-0.06456165015697479}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:39,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 5d4b5ec17541030a2731619cc0c22131: Running coprocessor pre-open hook at 1676153019692Writing region info on filesystem at 1676153019692Initializing all the Stores at 1676153019692Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019692Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153019692Cleaning up temporary data from old regions at 1676153019697 (+5 ms)Cleaning up detritus from prior splits at 1676153019698 (+1 ms)Running coprocessor post-open hooks at 1676153019701 (+3 ms)Region opened successfully at 1676153019701 2023-02-11 22:03:39,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131., pid=26, masterSystemTime=1676153019615 2023-02-11 22:03:39,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:39,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:39,703 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=5d4b5ec17541030a2731619cc0c22131, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,703 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153019703"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153019703"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153019703"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153019703"}]},"ts":"1676153019703"} 2023-02-11 22:03:39,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-11 22:03:39,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure 5d4b5ec17541030a2731619cc0c22131, server=jenkins-hbase9.apache.org,35641,1676153018101 in 246 msec 2023-02-11 22:03:39,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-11 22:03:39,707 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d4b5ec17541030a2731619cc0c22131, ASSIGN in 473 msec 2023-02-11 22:03:39,707 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:39,707 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153019707"}]},"ts":"1676153019707"} 2023-02-11 22:03:39,708 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-11 22:03:39,710 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:39,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 571 msec 2023-02-11 22:03:39,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:39,750 INFO [Listener at localhost/43127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-11 22:03:39,750 DEBUG [Listener at localhost/43127] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-11 22:03:39,750 INFO [Listener at localhost/43127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:39,765 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-11 22:03:39,766 INFO [Listener at localhost/43127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:39,766 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-11 22:03:39,766 INFO [Listener at localhost/43127] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 22:03:39,833 DEBUG [hconnection-0x6359424b-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:39,843 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49554, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:39,849 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45137] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:39,852 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35641] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:39,909 INFO [Listener at localhost/43127] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 22:03:39,910 INFO [Listener at localhost/43127] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 22:03:39,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-11 22:03:39,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676153019911 (current time:1676153019911). 2023-02-11 22:03:39,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 22:03:39,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] zookeeper.ReadOnlyZKClient(139): Connect 0x058b6d7b to 127.0.0.1:58447 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:39,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4eebcdd9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:39,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:39,920 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:39,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x058b6d7b to 127.0.0.1:58447 2023-02-11 22:03:39,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:39,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 22:03:39,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-11 22:03:39,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-11 22:03:39,925 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-11 22:03:39,925 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676153619925 2023-02-11 22:03:39,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-11 22:03:39,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,928 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-11 22:03:39,928 DEBUG [Listener at localhost/43127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:39,928 DEBUG [Listener at localhost/43127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 22:03:39,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-11 22:03:39,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 5 msec 2023-02-11 22:03:39,930 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-11 22:03:39,930 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676153619930 2023-02-11 22:03:39,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,942 INFO [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-11 22:03:39,942 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:39,943 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-11 22:03:39,943 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-11 22:03:39,943 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,943 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,945 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:39,945 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:39,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:39,945 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:39,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:39,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:39,945 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,945 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,946 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,946 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:39,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-11 22:03:39,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-11 22:03:39,946 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-11 22:03:39,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,946 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-11 22:03:39,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,947 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-11 22:03:39,947 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:39,953 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 22:03:39,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,953 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-11 22:03:39,953 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45137,1676153018073' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-11 22:03:39,953 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-11 22:03:39,953 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:39,953 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 22:03:39,953 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-11 22:03:39,953 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35641,1676153018101' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-11 22:03:39,954 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,954 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:39,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:39,955 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,955 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,955 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,955 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:39,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:39,955 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,955 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:39,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:39,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:39,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45137,1676153018073' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-11 22:03:39,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5409c29[Count = 1] remaining members to acquire global barrier 2023-02-11 22:03:39,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:39,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:39,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:39,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:39,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:39,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35641,1676153018101' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-11 22:03:39,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5409c29[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:39,958 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-11 22:03:39,958 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,959 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,959 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,959 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:39,959 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 22:03:39,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:39,960 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 22:03:39,960 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:39,960 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:39,960 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:39,960 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:39,960 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. started... 2023-02-11 22:03:39,960 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:39,960 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. started... 2023-02-11 22:03:39,960 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. started... 2023-02-11 22:03:39,963 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 22:03:39,963 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 22:03:39,963 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] regionserver.HRegion(2744): Flushing dd258983e5ed209f80e2edb232c68895 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 22:03:39,963 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5d4b5ec17541030a2731619cc0c22131 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:39,963 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 22:03:39,964 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:39,963 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c77a08c8939c5654bd5d2cdec1784dea 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:39,964 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. started... 2023-02-11 22:03:39,964 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 22:03:39,963 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:39,963 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:39,964 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. started... 2023-02-11 22:03:39,964 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. started... 2023-02-11 22:03:39,966 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 7ba50bc234474d8b78783b91ee87273b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:39,966 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 5174517129e32184c95d75c89c87312c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:39,966 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HRegion(2744): Flushing bc6dde637206fbcdc9221e940ba4c453 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:40,003 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/.tmp/f1/54bd82b444f7420bb22e1bd8aefd9b65 2023-02-11 22:03:40,004 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/.tmp/f1/2a5dcb65da254ff6aadc139ab1b71c3b 2023-02-11 22:03:40,005 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/.tmp/f1/49d60a3b86ff4920b8a93c77bea1ff04 2023-02-11 22:03:40,005 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/.tmp/f1/9fce42dc79a6424f84e5134e95a8f955 2023-02-11 22:03:40,008 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/.tmp/f1/50f0e3c6df414de9af892ca75531060a 2023-02-11 22:03:40,039 DEBUG [Listener at localhost/43127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:40,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-11 22:03:40,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:40,040 DEBUG [Listener at localhost/43127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 22:03:40,048 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/.tmp/f2/a97703125b5442f8b6fa7382885b06d2 2023-02-11 22:03:40,063 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/.tmp/f2/a4de47c282d34e2cb308607d9406efa0 2023-02-11 22:03:40,064 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/.tmp/f2/8c3e0365107e45b8b82c5dc9e58ca86e 2023-02-11 22:03:40,065 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/.tmp/f2/fb5ddeff2ec1451fb042f357a54d44b5 2023-02-11 22:03:40,067 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/.tmp/f2/a0b63dec722b4d54bd43ae7c0f3f22a6 2023-02-11 22:03:40,068 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/.tmp/f1/54bd82b444f7420bb22e1bd8aefd9b65 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1/54bd82b444f7420bb22e1bd8aefd9b65 2023-02-11 22:03:40,074 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/.tmp/f1/50f0e3c6df414de9af892ca75531060a as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1/50f0e3c6df414de9af892ca75531060a 2023-02-11 22:03:40,074 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/.tmp/f1/2a5dcb65da254ff6aadc139ab1b71c3b as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1/2a5dcb65da254ff6aadc139ab1b71c3b 2023-02-11 22:03:40,074 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/.tmp/f1/49d60a3b86ff4920b8a93c77bea1ff04 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1/49d60a3b86ff4920b8a93c77bea1ff04 2023-02-11 22:03:40,076 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1/54bd82b444f7420bb22e1bd8aefd9b65, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 22:03:40,076 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/.tmp/f1/9fce42dc79a6424f84e5134e95a8f955 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1/9fce42dc79a6424f84e5134e95a8f955 2023-02-11 22:03:40,077 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/.tmp/f2/a97703125b5442f8b6fa7382885b06d2 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2/a97703125b5442f8b6fa7382885b06d2 2023-02-11 22:03:40,080 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1/2a5dcb65da254ff6aadc139ab1b71c3b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:40,080 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1/50f0e3c6df414de9af892ca75531060a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:40,081 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1/49d60a3b86ff4920b8a93c77bea1ff04, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:40,081 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/.tmp/f2/fb5ddeff2ec1451fb042f357a54d44b5 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2/fb5ddeff2ec1451fb042f357a54d44b5 2023-02-11 22:03:40,082 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/.tmp/f2/8c3e0365107e45b8b82c5dc9e58ca86e as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2/8c3e0365107e45b8b82c5dc9e58ca86e 2023-02-11 22:03:40,082 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/.tmp/f2/a4de47c282d34e2cb308607d9406efa0 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2/a4de47c282d34e2cb308607d9406efa0 2023-02-11 22:03:40,085 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1/9fce42dc79a6424f84e5134e95a8f955, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:40,087 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/.tmp/f2/a0b63dec722b4d54bd43ae7c0f3f22a6 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2/a0b63dec722b4d54bd43ae7c0f3f22a6 2023-02-11 22:03:40,087 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2/8c3e0365107e45b8b82c5dc9e58ca86e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:40,088 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7ba50bc234474d8b78783b91ee87273b in 122ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:40,088 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-11 22:03:40,088 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 7ba50bc234474d8b78783b91ee87273b: 2023-02-11 22:03:40,088 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,090 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:40,090 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1/2a5dcb65da254ff6aadc139ab1b71c3b] hfiles 2023-02-11 22:03:40,090 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1/2a5dcb65da254ff6aadc139ab1b71c3b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,090 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2/8c3e0365107e45b8b82c5dc9e58ca86e] hfiles 2023-02-11 22:03:40,090 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2/8c3e0365107e45b8b82c5dc9e58ca86e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,091 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2/fb5ddeff2ec1451fb042f357a54d44b5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:40,092 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5174517129e32184c95d75c89c87312c in 126ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:40,096 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 5174517129e32184c95d75c89c87312c: 2023-02-11 22:03:40,096 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,099 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:40,099 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1/50f0e3c6df414de9af892ca75531060a] hfiles 2023-02-11 22:03:40,099 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1/50f0e3c6df414de9af892ca75531060a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,099 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2/fb5ddeff2ec1451fb042f357a54d44b5] hfiles 2023-02-11 22:03:40,099 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2/fb5ddeff2ec1451fb042f357a54d44b5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,101 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2/a4de47c282d34e2cb308607d9406efa0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:40,102 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2/a97703125b5442f8b6fa7382885b06d2, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 22:03:40,102 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bc6dde637206fbcdc9221e940ba4c453 in 136ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:40,102 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2/a0b63dec722b4d54bd43ae7c0f3f22a6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:40,102 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for bc6dde637206fbcdc9221e940ba4c453: 2023-02-11 22:03:40,102 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for dd258983e5ed209f80e2edb232c68895 in 139ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for dd258983e5ed209f80e2edb232c68895: 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1/49d60a3b86ff4920b8a93c77bea1ff04] hfiles 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1/49d60a3b86ff4920b8a93c77bea1ff04 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2/a4de47c282d34e2cb308607d9406efa0] hfiles 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2/a4de47c282d34e2cb308607d9406efa0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,103 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5d4b5ec17541030a2731619cc0c22131 in 140ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1/54bd82b444f7420bb22e1bd8aefd9b65] hfiles 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5d4b5ec17541030a2731619cc0c22131: 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1/54bd82b444f7420bb22e1bd8aefd9b65 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2/a97703125b5442f8b6fa7382885b06d2] hfiles 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,103 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2/a97703125b5442f8b6fa7382885b06d2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,104 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:40,104 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1/9fce42dc79a6424f84e5134e95a8f955] hfiles 2023-02-11 22:03:40,104 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1/9fce42dc79a6424f84e5134e95a8f955 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,104 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2/a0b63dec722b4d54bd43ae7c0f3f22a6] hfiles 2023-02-11 22:03:40,104 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2/a0b63dec722b4d54bd43ae7c0f3f22a6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,115 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. completed. 2023-02-11 22:03:40,115 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:40,115 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:40,115 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 22:03:40,115 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. started... 2023-02-11 22:03:40,119 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. completed. 2023-02-11 22:03:40,120 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:40,120 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:40,120 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2b81c83bbc762e01c0d4687ecc3e4d5f: 2023-02-11 22:03:40,120 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. started... 2023-02-11 22:03:40,120 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 22:03:40,120 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,122 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4c6bba163d882e30ed97ad7704071658 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 22:03:40,122 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:40,122 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 22:03:40,122 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 22:03:40,135 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. completed. 2023-02-11 22:03:40,135 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:40,135 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:40,136 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 22:03:40,136 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. started... 2023-02-11 22:03:40,137 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 02600f2e0b4f2b3f77cf9f34dcd31cdd 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 22:03:40,139 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. completed. 2023-02-11 22:03:40,139 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:40,139 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 22:03:40,140 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. completed. 2023-02-11 22:03:40,140 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:40,140 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:40,140 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 22:03:40,140 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. started... 2023-02-11 22:03:40,141 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ad58de138d24248fca2e889393c1191d: 2023-02-11 22:03:40,141 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,141 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:40,141 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 22:03:40,141 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 22:03:40,155 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. completed. 2023-02-11 22:03:40,155 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:40,155 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 22:03:40,159 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/.tmp/f1/da6234e0dff5421088f2468e01393da2 2023-02-11 22:03:40,167 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/.tmp/f1/721a9f35b21e4dfab86f546bfabe7c3c 2023-02-11 22:03:40,173 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. completed. 2023-02-11 22:03:40,173 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:40,173 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 22:03:40,187 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/.tmp/f2/2a3a243e70e44c68ac940b00d0944ff7 2023-02-11 22:03:40,191 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/.tmp/f1/721a9f35b21e4dfab86f546bfabe7c3c as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1/721a9f35b21e4dfab86f546bfabe7c3c 2023-02-11 22:03:40,196 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1/721a9f35b21e4dfab86f546bfabe7c3c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:40,197 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/.tmp/f2/2a3a243e70e44c68ac940b00d0944ff7 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2/2a3a243e70e44c68ac940b00d0944ff7 2023-02-11 22:03:40,199 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/.tmp/f2/1e355acbb27f48038b6a6efb2302b484 2023-02-11 22:03:40,203 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2/2a3a243e70e44c68ac940b00d0944ff7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:40,204 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/.tmp/f1/da6234e0dff5421088f2468e01393da2 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1/da6234e0dff5421088f2468e01393da2 2023-02-11 22:03:40,204 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 02600f2e0b4f2b3f77cf9f34dcd31cdd in 67ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:40,204 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 02600f2e0b4f2b3f77cf9f34dcd31cdd: 2023-02-11 22:03:40,204 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,204 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:40,204 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1/721a9f35b21e4dfab86f546bfabe7c3c] hfiles 2023-02-11 22:03:40,204 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1/721a9f35b21e4dfab86f546bfabe7c3c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,204 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2/2a3a243e70e44c68ac940b00d0944ff7] hfiles 2023-02-11 22:03:40,204 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2/2a3a243e70e44c68ac940b00d0944ff7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,213 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1/da6234e0dff5421088f2468e01393da2, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 22:03:40,214 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/.tmp/f2/1e355acbb27f48038b6a6efb2302b484 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2/1e355acbb27f48038b6a6efb2302b484 2023-02-11 22:03:40,217 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2/1e355acbb27f48038b6a6efb2302b484, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 22:03:40,220 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 4c6bba163d882e30ed97ad7704071658 in 98ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:40,221 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4c6bba163d882e30ed97ad7704071658: 2023-02-11 22:03:40,221 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,221 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:40,221 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1/da6234e0dff5421088f2468e01393da2] hfiles 2023-02-11 22:03:40,221 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1/da6234e0dff5421088f2468e01393da2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,221 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2/1e355acbb27f48038b6a6efb2302b484] hfiles 2023-02-11 22:03:40,221 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2/1e355acbb27f48038b6a6efb2302b484 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,222 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. completed. 2023-02-11 22:03:40,223 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:40,223 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 22:03:40,223 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 22:03:40,223 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,223 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-11 22:03:40,223 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,45137,1676153018073' in zk 2023-02-11 22:03:40,226 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,226 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-11 22:03:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:40,226 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:40,226 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-11 22:03:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,227 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. completed. 2023-02-11 22:03:40,228 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:40,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,228 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 22:03:40,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:40,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,45137,1676153018073': 2023-02-11 22:03:40,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45137,1676153018073' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-11 22:03:40,240 DEBUG [Listener at localhost/43127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:40,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-11 22:03:40,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:40,242 DEBUG [Listener at localhost/43127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 22:03:40,396 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/.tmp/f1/292ee2ac10ee41c2a828f6a8e08d3bb1 2023-02-11 22:03:40,409 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/.tmp/f2/83418beb454149e78465d95328420fca 2023-02-11 22:03:40,414 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/.tmp/f1/292ee2ac10ee41c2a828f6a8e08d3bb1 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1/292ee2ac10ee41c2a828f6a8e08d3bb1 2023-02-11 22:03:40,417 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1/292ee2ac10ee41c2a828f6a8e08d3bb1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:40,418 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/.tmp/f2/83418beb454149e78465d95328420fca as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2/83418beb454149e78465d95328420fca 2023-02-11 22:03:40,422 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2/83418beb454149e78465d95328420fca, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 22:03:40,423 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c77a08c8939c5654bd5d2cdec1784dea in 460ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:40,423 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c77a08c8939c5654bd5d2cdec1784dea: 2023-02-11 22:03:40,423 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,424 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:40,424 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1/292ee2ac10ee41c2a828f6a8e08d3bb1] hfiles 2023-02-11 22:03:40,424 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1/292ee2ac10ee41c2a828f6a8e08d3bb1 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,424 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2/83418beb454149e78465d95328420fca] hfiles 2023-02-11 22:03:40,424 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2/83418beb454149e78465d95328420fca for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,429 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. completed. 2023-02-11 22:03:40,429 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:40,429 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 22:03:40,429 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 22:03:40,429 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,429 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-11 22:03:40,429 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,35641,1676153018101' in zk 2023-02-11 22:03:40,431 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-11 22:03:40,431 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,431 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:40,431 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-11 22:03:40,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:40,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:40,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:40,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,35641,1676153018101': 2023-02-11 22:03:40,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35641,1676153018101' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-11 22:03:40,435 INFO [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-11 22:03:40,435 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:40,435 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:40,435 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,435 INFO [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 22:03:40,436 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,436 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:40,436 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,436 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:40,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,437 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:40,437 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:40,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,437 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,439 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:40,439 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,444 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,444 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,444 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:40,444 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:40,444 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,444 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:40,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:40,444 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,444 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:40,444 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:40,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:40,444 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:40,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,445 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:40,445 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,445 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,445 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:40,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:40,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:40,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:40,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,512 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-11 22:03:40,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,512 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676153019926Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676153020444 (+518 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676153020445 (+1 ms)Writing data manifest for testWithMockedMapReduceMultiRegion at 1676153020456 (+11 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676153020481 (+25 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676153020512 (+31 ms) 2023-02-11 22:03:40,514 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-11 22:03:40,515 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 586 msec 2023-02-11 22:03:40,542 DEBUG [Listener at localhost/43127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:40,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-11 22:03:40,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 22:03:40,544 INFO [Listener at localhost/43127] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 22:03:40,547 INFO [Listener at localhost/43127] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 22:03:40,552 INFO [Listener at localhost/43127] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 22:03:40,578 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45137] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:40,580 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35641] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:40,646 INFO [Listener at localhost/43127] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 22:03:40,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-11 22:03:40,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,655 INFO [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-11 22:03:40,655 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:40,656 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-11 22:03:40,656 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-11 22:03:40,657 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,657 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,658 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:40,658 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:40,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:40,658 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,659 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,659 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,659 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:40,659 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,659 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,659 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,660 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-11 22:03:40,660 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-11 22:03:40,660 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:40,660 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:40,661 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 22:03:40,662 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 22:03:40,662 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:40,662 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. started... 2023-02-11 22:03:40,662 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:40,662 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing dd258983e5ed209f80e2edb232c68895 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 22:03:40,662 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 22:03:40,662 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 22:03:40,662 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. started... 2023-02-11 22:03:40,662 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:40,662 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:40,662 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:40,662 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5d4b5ec17541030a2731619cc0c22131 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:40,662 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 22:03:40,663 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 22:03:40,662 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:40,663 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. started... 2023-02-11 22:03:40,663 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. started... 2023-02-11 22:03:40,664 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c77a08c8939c5654bd5d2cdec1784dea 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:40,664 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7ba50bc234474d8b78783b91ee87273b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:40,663 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. started... 2023-02-11 22:03:40,663 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. started... 2023-02-11 22:03:40,664 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5174517129e32184c95d75c89c87312c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:40,668 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bc6dde637206fbcdc9221e940ba4c453 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:40,696 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/.tmp/f1/1b33e17d98d74eabb5b28f58ae117456 2023-02-11 22:03:40,696 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/.tmp/f1/0a8d56659d684a4c8daa134c368d3db3 2023-02-11 22:03:40,703 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/.tmp/f1/925c69115232431e8143135dd73fff46 2023-02-11 22:03:40,703 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/.tmp/f1/57f5102f63db4fd899b878882cbd0a3a 2023-02-11 22:03:40,713 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/.tmp/f1/fd1a3197d5684d529b5a74da8dcfe327 2023-02-11 22:03:40,743 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/.tmp/f2/03faf0cb1c4e48899e0e504d19c840a2 2023-02-11 22:03:40,751 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/.tmp/f2/37e78557f02c4875857d42c9438e0720 2023-02-11 22:03:40,752 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/.tmp/f1/0a8d56659d684a4c8daa134c368d3db3 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1/0a8d56659d684a4c8daa134c368d3db3 2023-02-11 22:03:40,756 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/.tmp/f1/1b33e17d98d74eabb5b28f58ae117456 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1/1b33e17d98d74eabb5b28f58ae117456 2023-02-11 22:03:40,757 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1/0a8d56659d684a4c8daa134c368d3db3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:40,757 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/.tmp/f2/03faf0cb1c4e48899e0e504d19c840a2 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2/03faf0cb1c4e48899e0e504d19c840a2 2023-02-11 22:03:40,759 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/.tmp/f2/2a0182b4464947b3b0b57011d80ca518 2023-02-11 22:03:40,760 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/.tmp/f2/64ea9f477de6444d9bc4561b3da23ae4 2023-02-11 22:03:40,761 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1/1b33e17d98d74eabb5b28f58ae117456, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:40,762 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/.tmp/f2/37e78557f02c4875857d42c9438e0720 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2/37e78557f02c4875857d42c9438e0720 2023-02-11 22:03:40,763 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2/03faf0cb1c4e48899e0e504d19c840a2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:40,765 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5d4b5ec17541030a2731619cc0c22131 in 102ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:40,765 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5d4b5ec17541030a2731619cc0c22131: 2023-02-11 22:03:40,765 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:40,765 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/.tmp/f1/57f5102f63db4fd899b878882cbd0a3a as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1/57f5102f63db4fd899b878882cbd0a3a 2023-02-11 22:03:40,765 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/.tmp/f2/d5cd9273a086406aa19a892c6c40fa7d 2023-02-11 22:03:40,767 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2/37e78557f02c4875857d42c9438e0720, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:40,770 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c77a08c8939c5654bd5d2cdec1784dea in 106ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:40,770 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c77a08c8939c5654bd5d2cdec1784dea: 2023-02-11 22:03:40,770 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:40,770 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:40,770 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. started... 2023-02-11 22:03:40,770 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4c6bba163d882e30ed97ad7704071658 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 22:03:40,770 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/.tmp/f1/925c69115232431e8143135dd73fff46 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1/925c69115232431e8143135dd73fff46 2023-02-11 22:03:40,771 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:40,771 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 22:03:40,771 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. started... 2023-02-11 22:03:40,771 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 22:03:40,771 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ad58de138d24248fca2e889393c1191d: 2023-02-11 22:03:40,771 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:40,771 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 22:03:40,773 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1/57f5102f63db4fd899b878882cbd0a3a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:40,774 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/.tmp/f2/2a0182b4464947b3b0b57011d80ca518 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2/2a0182b4464947b3b0b57011d80ca518 2023-02-11 22:03:40,775 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/.tmp/f1/fd1a3197d5684d529b5a74da8dcfe327 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1/fd1a3197d5684d529b5a74da8dcfe327 2023-02-11 22:03:40,776 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1/925c69115232431e8143135dd73fff46, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 22:03:40,777 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/.tmp/f2/d5cd9273a086406aa19a892c6c40fa7d as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2/d5cd9273a086406aa19a892c6c40fa7d 2023-02-11 22:03:40,778 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2/2a0182b4464947b3b0b57011d80ca518, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:40,779 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bc6dde637206fbcdc9221e940ba4c453 in 115ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:40,779 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bc6dde637206fbcdc9221e940ba4c453: 2023-02-11 22:03:40,779 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:40,779 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:40,779 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 22:03:40,779 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. started... 2023-02-11 22:03:40,779 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2b81c83bbc762e01c0d4687ecc3e4d5f: 2023-02-11 22:03:40,779 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:40,779 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:40,779 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. started... 2023-02-11 22:03:40,779 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 22:03:40,779 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 02600f2e0b4f2b3f77cf9f34dcd31cdd 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 22:03:40,780 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1/fd1a3197d5684d529b5a74da8dcfe327, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:40,783 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/.tmp/f2/64ea9f477de6444d9bc4561b3da23ae4 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2/64ea9f477de6444d9bc4561b3da23ae4 2023-02-11 22:03:40,785 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2/d5cd9273a086406aa19a892c6c40fa7d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 22:03:40,786 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for dd258983e5ed209f80e2edb232c68895 in 124ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:40,786 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for dd258983e5ed209f80e2edb232c68895: 2023-02-11 22:03:40,787 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:40,787 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 22:03:40,788 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2/64ea9f477de6444d9bc4561b3da23ae4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:40,788 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7ba50bc234474d8b78783b91ee87273b in 124ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:40,789 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7ba50bc234474d8b78783b91ee87273b: 2023-02-11 22:03:40,789 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:40,789 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 22:03:40,794 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/.tmp/f1/e511f80f623b4a46ba079e0eb3aa08f9 2023-02-11 22:03:40,796 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/.tmp/f1/3936008692944b53a679221a00d7df2b 2023-02-11 22:03:40,820 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/.tmp/f2/0f7d5eff81b24706aee1d2160ed22f71 2023-02-11 22:03:40,821 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/.tmp/f2/3b88b1754bf34fba935fd6c9abbced9d 2023-02-11 22:03:40,827 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/.tmp/f1/3936008692944b53a679221a00d7df2b as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1/3936008692944b53a679221a00d7df2b 2023-02-11 22:03:40,827 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/.tmp/f1/e511f80f623b4a46ba079e0eb3aa08f9 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1/e511f80f623b4a46ba079e0eb3aa08f9 2023-02-11 22:03:40,831 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1/3936008692944b53a679221a00d7df2b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:40,831 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1/e511f80f623b4a46ba079e0eb3aa08f9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 22:03:40,832 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/.tmp/f2/0f7d5eff81b24706aee1d2160ed22f71 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2/0f7d5eff81b24706aee1d2160ed22f71 2023-02-11 22:03:40,832 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/.tmp/f2/3b88b1754bf34fba935fd6c9abbced9d as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2/3b88b1754bf34fba935fd6c9abbced9d 2023-02-11 22:03:40,839 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2/0f7d5eff81b24706aee1d2160ed22f71, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:40,840 INFO [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 02600f2e0b4f2b3f77cf9f34dcd31cdd in 61ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:40,840 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 02600f2e0b4f2b3f77cf9f34dcd31cdd: 2023-02-11 22:03:40,840 DEBUG [rs(jenkins-hbase9.apache.org,45137,1676153018073)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:40,840 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 22:03:40,840 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 22:03:40,840 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,840 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-11 22:03:40,840 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45137,1676153018073' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-11 22:03:40,841 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2/3b88b1754bf34fba935fd6c9abbced9d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 22:03:40,842 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 4c6bba163d882e30ed97ad7704071658 in 72ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:40,842 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4c6bba163d882e30ed97ad7704071658: 2023-02-11 22:03:40,842 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:40,842 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 22:03:40,842 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,842 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:40,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:40,842 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,842 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:40,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:40,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:40,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:40,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:40,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:40,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45137,1676153018073' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-11 22:03:40,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17f0859[Count = 1] remaining members to acquire global barrier 2023-02-11 22:03:41,109 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/.tmp/f1/180b3e8619214e6d8711c6c3aca94ec3 2023-02-11 22:03:41,125 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/.tmp/f2/dc1c5278f6394dc898e153f98e642228 2023-02-11 22:03:41,129 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/.tmp/f1/180b3e8619214e6d8711c6c3aca94ec3 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1/180b3e8619214e6d8711c6c3aca94ec3 2023-02-11 22:03:41,133 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1/180b3e8619214e6d8711c6c3aca94ec3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:41,134 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/.tmp/f2/dc1c5278f6394dc898e153f98e642228 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2/dc1c5278f6394dc898e153f98e642228 2023-02-11 22:03:41,138 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2/dc1c5278f6394dc898e153f98e642228, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 22:03:41,139 INFO [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5174517129e32184c95d75c89c87312c in 475ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:41,139 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5174517129e32184c95d75c89c87312c: 2023-02-11 22:03:41,139 DEBUG [rs(jenkins-hbase9.apache.org,35641,1676153018101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:41,139 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 22:03:41,139 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 22:03:41,139 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,139 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-11 22:03:41,139 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35641,1676153018101' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-11 22:03:41,141 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,141 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:41,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:41,141 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,141 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:41,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:41,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:41,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:41,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35641,1676153018101' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-11 22:03:41,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17f0859[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:41,143 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-11 22:03:41,143 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,145 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,145 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,145 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 22:03:41,145 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-11 22:03:41,145 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 22:03:41,145 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,145 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-11 22:03:41,145 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,45137,1676153018073' in zk 2023-02-11 22:03:41,145 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,35641,1676153018101' in zk 2023-02-11 22:03:41,146 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,146 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:41,147 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-11 22:03:41,147 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:41,147 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,147 DEBUG [member: 'jenkins-hbase9.apache.org,45137,1676153018073' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-11 22:03:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:41,147 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,147 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-11 22:03:41,147 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:41,147 DEBUG [member: 'jenkins-hbase9.apache.org,35641,1676153018101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-11 22:03:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:41,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,45137,1676153018073': 2023-02-11 22:03:41,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45137,1676153018073' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-11 22:03:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,35641,1676153018101': 2023-02-11 22:03:41,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35641,1676153018101' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-11 22:03:41,152 INFO [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-11 22:03:41,152 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:41,152 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:41,152 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,152 INFO [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 22:03:41,153 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,153 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,153 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:41,153 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,154 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:41,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:41,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:41,154 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,155 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:41,156 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,156 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,160 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,160 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,160 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:41,160 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:41,160 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:41,160 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:41,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-11 22:03:41,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 22:03:41,160 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,160 DEBUG [(jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:41,161 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:41,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:41,161 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,160 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:41,161 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:41,161 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,161 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,161 DEBUG [Listener at localhost/43127] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:41,161 DEBUG [Listener at localhost/43127] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 22:03:41,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:41,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:41,261 DEBUG [Listener at localhost/43127] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 22:03:41,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 22:03:41,266 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676153019911 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:41,266 DEBUG [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(239): region to add: dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(239): region to add: 5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(239): region to add: c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(239): region to add: 5174517129e32184c95d75c89c87312c 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(239): region to add: bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(239): region to add: 4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(239): region to add: 7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(239): region to add: 2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(239): region to add: 02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(239): region to add: ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(585): clone region=dd258983e5ed209f80e2edb232c68895 as dd258983e5ed209f80e2edb232c68895 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(585): clone region=5d4b5ec17541030a2731619cc0c22131 as 5d4b5ec17541030a2731619cc0c22131 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(585): clone region=c77a08c8939c5654bd5d2cdec1784dea as c77a08c8939c5654bd5d2cdec1784dea in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,267 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(585): clone region=5174517129e32184c95d75c89c87312c as 5174517129e32184c95d75c89c87312c in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,268 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(585): clone region=bc6dde637206fbcdc9221e940ba4c453 as bc6dde637206fbcdc9221e940ba4c453 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,268 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(585): clone region=4c6bba163d882e30ed97ad7704071658 as 4c6bba163d882e30ed97ad7704071658 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,268 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(585): clone region=7ba50bc234474d8b78783b91ee87273b as 7ba50bc234474d8b78783b91ee87273b in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,268 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(585): clone region=2b81c83bbc762e01c0d4687ecc3e4d5f as 2b81c83bbc762e01c0d4687ecc3e4d5f in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,268 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(585): clone region=02600f2e0b4f2b3f77cf9f34dcd31cdd as 02600f2e0b4f2b3f77cf9f34dcd31cdd in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,268 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(585): clone region=ad58de138d24248fca2e889393c1191d as ad58de138d24248fca2e889393c1191d in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,269 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 7ba50bc234474d8b78783b91ee87273b, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee 2023-02-11 22:03:41,270 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => dd258983e5ed209f80e2edb232c68895, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee 2023-02-11 22:03:41,270 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 4c6bba163d882e30ed97ad7704071658, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee 2023-02-11 22:03:41,270 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 5174517129e32184c95d75c89c87312c, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee 2023-02-11 22:03:41,270 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => c77a08c8939c5654bd5d2cdec1784dea, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee 2023-02-11 22:03:41,270 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5d4b5ec17541030a2731619cc0c22131, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee 2023-02-11 22:03:41,271 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 2b81c83bbc762e01c0d4687ecc3e4d5f, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee 2023-02-11 22:03:41,271 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => bc6dde637206fbcdc9221e940ba4c453, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee 2023-02-11 22:03:41,290 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:41,291 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 292ee2ac10ee41c2a828f6a8e08d3bb1 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,303 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 83418beb454149e78465d95328420fca from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,304 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:41,304 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink da6234e0dff5421088f2468e01393da2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,307 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:41,307 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 2b81c83bbc762e01c0d4687ecc3e4d5f, disabling compactions & flushes 2023-02-11 22:03:41,307 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:41,307 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:41,307 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. after waiting 0 ms 2023-02-11 22:03:41,307 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:41,307 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:41,307 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 2b81c83bbc762e01c0d4687ecc3e4d5f: Waiting for close lock at 1676153021307Disabling compacts and flushes for region at 1676153021307Disabling writes for close at 1676153021307Writing region close event to WAL at 1676153021307Closed at 1676153021307 2023-02-11 22:03:41,308 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 02600f2e0b4f2b3f77cf9f34dcd31cdd, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee 2023-02-11 22:03:41,309 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1e355acbb27f48038b6a6efb2302b484 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,312 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:41,312 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2a5dcb65da254ff6aadc139ab1b71c3b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,313 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:41,313 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 49d60a3b86ff4920b8a93c77bea1ff04 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,313 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:41,313 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9fce42dc79a6424f84e5134e95a8f955 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,313 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing c77a08c8939c5654bd5d2cdec1784dea, disabling compactions & flushes 2023-02-11 22:03:41,313 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:41,313 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:41,313 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. after waiting 0 ms 2023-02-11 22:03:41,313 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:41,313 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:41,314 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for c77a08c8939c5654bd5d2cdec1784dea: Waiting for close lock at 1676153021313Disabling compacts and flushes for region at 1676153021313Disabling writes for close at 1676153021313Writing region close event to WAL at 1676153021313Closed at 1676153021313 2023-02-11 22:03:41,314 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => ad58de138d24248fca2e889393c1191d, NAME => 'testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee 2023-02-11 22:03:41,315 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 4c6bba163d882e30ed97ad7704071658, disabling compactions & flushes 2023-02-11 22:03:41,315 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:41,315 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:41,315 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. after waiting 0 ms 2023-02-11 22:03:41,315 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:41,315 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:41,315 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 4c6bba163d882e30ed97ad7704071658: Waiting for close lock at 1676153021315Disabling compacts and flushes for region at 1676153021315Disabling writes for close at 1676153021315Writing region close event to WAL at 1676153021315Closed at 1676153021315 2023-02-11 22:03:41,316 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:41,316 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 50f0e3c6df414de9af892ca75531060a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,326 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fb5ddeff2ec1451fb042f357a54d44b5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,326 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a0b63dec722b4d54bd43ae7c0f3f22a6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,327 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a4de47c282d34e2cb308607d9406efa0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,327 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8c3e0365107e45b8b82c5dc9e58ca86e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,331 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:41,331 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 721a9f35b21e4dfab86f546bfabe7c3c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,332 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 7ba50bc234474d8b78783b91ee87273b, disabling compactions & flushes 2023-02-11 22:03:41,332 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. after waiting 0 ms 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:41,333 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 7ba50bc234474d8b78783b91ee87273b: Waiting for close lock at 1676153021332Disabling compacts and flushes for region at 1676153021332Disabling writes for close at 1676153021333 (+1 ms)Writing region close event to WAL at 1676153021333Closed at 1676153021333 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing bc6dde637206fbcdc9221e940ba4c453, disabling compactions & flushes 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 5174517129e32184c95d75c89c87312c, disabling compactions & flushes 2023-02-11 22:03:41,333 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:41,333 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2a3a243e70e44c68ac940b00d0944ff7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,333 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. after waiting 0 ms 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. after waiting 0 ms 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:41,333 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:41,333 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 5174517129e32184c95d75c89c87312c: Waiting for close lock at 1676153021333Disabling compacts and flushes for region at 1676153021333Disabling writes for close at 1676153021333Writing region close event to WAL at 1676153021333Closed at 1676153021333 2023-02-11 22:03:41,333 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for bc6dde637206fbcdc9221e940ba4c453: Waiting for close lock at 1676153021333Disabling compacts and flushes for region at 1676153021333Disabling writes for close at 1676153021333Writing region close event to WAL at 1676153021333Closed at 1676153021333 2023-02-11 22:03:41,337 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 02600f2e0b4f2b3f77cf9f34dcd31cdd, disabling compactions & flushes 2023-02-11 22:03:41,337 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:41,337 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:41,337 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. after waiting 0 ms 2023-02-11 22:03:41,337 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:41,337 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:41,337 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 02600f2e0b4f2b3f77cf9f34dcd31cdd: Waiting for close lock at 1676153021337Disabling compacts and flushes for region at 1676153021337Disabling writes for close at 1676153021337Writing region close event to WAL at 1676153021337Closed at 1676153021337 2023-02-11 22:03:41,338 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 5d4b5ec17541030a2731619cc0c22131, disabling compactions & flushes 2023-02-11 22:03:41,338 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:41,338 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:41,338 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. after waiting 0 ms 2023-02-11 22:03:41,338 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:41,338 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:41,338 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 5d4b5ec17541030a2731619cc0c22131: Waiting for close lock at 1676153021338Disabling compacts and flushes for region at 1676153021338Disabling writes for close at 1676153021338Writing region close event to WAL at 1676153021338Closed at 1676153021338 2023-02-11 22:03:41,339 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:41,339 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing ad58de138d24248fca2e889393c1191d, disabling compactions & flushes 2023-02-11 22:03:41,339 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:41,339 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:41,339 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. after waiting 0 ms 2023-02-11 22:03:41,339 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:41,339 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:41,339 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for ad58de138d24248fca2e889393c1191d: Waiting for close lock at 1676153021339Disabling compacts and flushes for region at 1676153021339Disabling writes for close at 1676153021339Writing region close event to WAL at 1676153021339Closed at 1676153021339 2023-02-11 22:03:41,718 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:41,718 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 54bd82b444f7420bb22e1bd8aefd9b65 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,721 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a97703125b5442f8b6fa7382885b06d2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:41,723 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing dd258983e5ed209f80e2edb232c68895, disabling compactions & flushes 2023-02-11 22:03:41,723 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:41,723 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:41,723 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. after waiting 0 ms 2023-02-11 22:03:41,723 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:41,723 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:41,723 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for dd258983e5ed209f80e2edb232c68895: Waiting for close lock at 1676153021723Disabling compacts and flushes for region at 1676153021723Disabling writes for close at 1676153021723Writing region close event to WAL at 1676153021723Closed at 1676153021723 2023-02-11 22:03:41,723 INFO [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676153019911 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:41,723 DEBUG [Listener at localhost/43127] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee 2023-02-11 22:03:41,723 DEBUG [Listener at localhost/43127] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee 2023-02-11 22:03:41,724 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-data/ 2023-02-11 22:03:41,724 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |----default/ 2023-02-11 22:03:41,725 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-11 22:03:41,725 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |----------02600f2e0b4f2b3f77cf9f34dcd31cdd/ 2023-02-11 22:03:41,726 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:41,726 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:41,726 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=02600f2e0b4f2b3f77cf9f34dcd31cdd-721a9f35b21e4dfab86f546bfabe7c3c 2023-02-11 22:03:41,726 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:41,727 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=02600f2e0b4f2b3f77cf9f34dcd31cdd-2a3a243e70e44c68ac940b00d0944ff7 2023-02-11 22:03:41,727 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |----------2b81c83bbc762e01c0d4687ecc3e4d5f/ 2023-02-11 22:03:41,727 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:41,727 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |----------4c6bba163d882e30ed97ad7704071658/ 2023-02-11 22:03:41,727 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:41,727 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:41,728 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4c6bba163d882e30ed97ad7704071658-da6234e0dff5421088f2468e01393da2 2023-02-11 22:03:41,728 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:41,728 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4c6bba163d882e30ed97ad7704071658-1e355acbb27f48038b6a6efb2302b484 2023-02-11 22:03:41,728 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |----------5174517129e32184c95d75c89c87312c/ 2023-02-11 22:03:41,728 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:41,728 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:41,729 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5174517129e32184c95d75c89c87312c-50f0e3c6df414de9af892ca75531060a 2023-02-11 22:03:41,729 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:41,729 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5174517129e32184c95d75c89c87312c-fb5ddeff2ec1451fb042f357a54d44b5 2023-02-11 22:03:41,729 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |----------5d4b5ec17541030a2731619cc0c22131/ 2023-02-11 22:03:41,729 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:41,729 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:41,730 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5d4b5ec17541030a2731619cc0c22131-9fce42dc79a6424f84e5134e95a8f955 2023-02-11 22:03:41,730 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:41,730 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5d4b5ec17541030a2731619cc0c22131-a0b63dec722b4d54bd43ae7c0f3f22a6 2023-02-11 22:03:41,730 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |----------7ba50bc234474d8b78783b91ee87273b/ 2023-02-11 22:03:41,730 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:41,730 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:41,731 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7ba50bc234474d8b78783b91ee87273b-2a5dcb65da254ff6aadc139ab1b71c3b 2023-02-11 22:03:41,731 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:41,731 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7ba50bc234474d8b78783b91ee87273b-8c3e0365107e45b8b82c5dc9e58ca86e 2023-02-11 22:03:41,731 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |----------ad58de138d24248fca2e889393c1191d/ 2023-02-11 22:03:41,731 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:41,732 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |----------bc6dde637206fbcdc9221e940ba4c453/ 2023-02-11 22:03:41,732 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:41,732 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:41,732 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=bc6dde637206fbcdc9221e940ba4c453-49d60a3b86ff4920b8a93c77bea1ff04 2023-02-11 22:03:41,732 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:41,733 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=bc6dde637206fbcdc9221e940ba4c453-a4de47c282d34e2cb308607d9406efa0 2023-02-11 22:03:41,733 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |----------c77a08c8939c5654bd5d2cdec1784dea/ 2023-02-11 22:03:41,733 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:41,733 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:41,733 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c77a08c8939c5654bd5d2cdec1784dea-292ee2ac10ee41c2a828f6a8e08d3bb1 2023-02-11 22:03:41,733 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:41,734 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c77a08c8939c5654bd5d2cdec1784dea-83418beb454149e78465d95328420fca 2023-02-11 22:03:41,734 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |----------dd258983e5ed209f80e2edb232c68895/ 2023-02-11 22:03:41,734 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:41,734 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:41,734 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=dd258983e5ed209f80e2edb232c68895-54bd82b444f7420bb22e1bd8aefd9b65 2023-02-11 22:03:41,734 DEBUG [Listener at localhost/43127] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:41,735 DEBUG [Listener at localhost/43127] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=dd258983e5ed209f80e2edb232c68895-a97703125b5442f8b6fa7382885b06d2 2023-02-11 22:03:41,738 INFO [Listener at localhost/43127] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 22:03:42,267 DEBUG [Listener at localhost/43127] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:42,267 INFO [Listener at localhost/43127] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:42,269 DEBUG [Listener at localhost/43127] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:42,271 INFO [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:42,272 DEBUG [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1 2023-02-11 22:03:42,272 INFO [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02600f2e0b4f2b3f77cf9f34dcd31cdd columnFamilyName f1 2023-02-11 22:03:42,277 DEBUG [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1/testWithMockedMapReduceMultiRegion=02600f2e0b4f2b3f77cf9f34dcd31cdd-721a9f35b21e4dfab86f546bfabe7c3c 2023-02-11 22:03:42,277 INFO [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] regionserver.HStore(310): Store=02600f2e0b4f2b3f77cf9f34dcd31cdd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,277 INFO [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:42,278 DEBUG [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2 2023-02-11 22:03:42,278 INFO [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02600f2e0b4f2b3f77cf9f34dcd31cdd columnFamilyName f2 2023-02-11 22:03:42,282 DEBUG [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2/testWithMockedMapReduceMultiRegion=02600f2e0b4f2b3f77cf9f34dcd31cdd-2a3a243e70e44c68ac940b00d0944ff7 2023-02-11 22:03:42,283 INFO [StoreOpener-02600f2e0b4f2b3f77cf9f34dcd31cdd-1] regionserver.HStore(310): Store=02600f2e0b4f2b3f77cf9f34dcd31cdd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,283 DEBUG [Listener at localhost/43127] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:42,283 INFO [Listener at localhost/43127] regionserver.HRegion(1071): Opened 02600f2e0b4f2b3f77cf9f34dcd31cdd; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63003873, jitterRate=-0.061169132590293884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:42,283 DEBUG [Listener at localhost/43127] regionserver.HRegion(964): Region open journal for 02600f2e0b4f2b3f77cf9f34dcd31cdd: Writing region info on filesystem at 1676153022269Initializing all the Stores at 1676153022270 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022270Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022270Region opened successfully at 1676153022283 (+13 ms) 2023-02-11 22:03:42,295 DEBUG [Listener at localhost/43127] regionserver.HRegion(1603): Closing 02600f2e0b4f2b3f77cf9f34dcd31cdd, disabling compactions & flushes 2023-02-11 22:03:42,295 INFO [Listener at localhost/43127] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:42,295 DEBUG [Listener at localhost/43127] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:42,296 DEBUG [Listener at localhost/43127] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. after waiting 0 ms 2023-02-11 22:03:42,296 DEBUG [Listener at localhost/43127] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:42,296 INFO [Listener at localhost/43127] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:42,297 DEBUG [Listener at localhost/43127] regionserver.HRegion(1557): Region close journal for 02600f2e0b4f2b3f77cf9f34dcd31cdd: Waiting for close lock at 1676153022295Disabling compacts and flushes for region at 1676153022295Disabling writes for close at 1676153022296 (+1 ms)Writing region close event to WAL at 1676153022296Closed at 1676153022296 2023-02-11 22:03:42,297 DEBUG [Listener at localhost/43127] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:42,298 INFO [Listener at localhost/43127] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:42,304 DEBUG [Listener at localhost/43127] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:42,306 INFO [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:42,307 DEBUG [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1 2023-02-11 22:03:42,307 INFO [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c6bba163d882e30ed97ad7704071658 columnFamilyName f1 2023-02-11 22:03:42,312 DEBUG [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1/testWithMockedMapReduceMultiRegion=4c6bba163d882e30ed97ad7704071658-da6234e0dff5421088f2468e01393da2 2023-02-11 22:03:42,312 INFO [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] regionserver.HStore(310): Store=4c6bba163d882e30ed97ad7704071658/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,312 INFO [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:42,313 DEBUG [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2 2023-02-11 22:03:42,313 INFO [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c6bba163d882e30ed97ad7704071658 columnFamilyName f2 2023-02-11 22:03:42,317 DEBUG [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2/testWithMockedMapReduceMultiRegion=4c6bba163d882e30ed97ad7704071658-1e355acbb27f48038b6a6efb2302b484 2023-02-11 22:03:42,317 INFO [StoreOpener-4c6bba163d882e30ed97ad7704071658-1] regionserver.HStore(310): Store=4c6bba163d882e30ed97ad7704071658/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,317 DEBUG [Listener at localhost/43127] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:42,317 INFO [Listener at localhost/43127] regionserver.HRegion(1071): Opened 4c6bba163d882e30ed97ad7704071658; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61959649, jitterRate=-0.07672928273677826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:42,317 DEBUG [Listener at localhost/43127] regionserver.HRegion(964): Region open journal for 4c6bba163d882e30ed97ad7704071658: Writing region info on filesystem at 1676153022304Initializing all the Stores at 1676153022305 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022305Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022305Region opened successfully at 1676153022317 (+12 ms) 2023-02-11 22:03:42,328 DEBUG [Listener at localhost/43127] regionserver.HRegion(1603): Closing 4c6bba163d882e30ed97ad7704071658, disabling compactions & flushes 2023-02-11 22:03:42,328 INFO [Listener at localhost/43127] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:42,328 DEBUG [Listener at localhost/43127] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:42,328 DEBUG [Listener at localhost/43127] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. after waiting 0 ms 2023-02-11 22:03:42,328 DEBUG [Listener at localhost/43127] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:42,328 INFO [Listener at localhost/43127] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:42,328 DEBUG [Listener at localhost/43127] regionserver.HRegion(1557): Region close journal for 4c6bba163d882e30ed97ad7704071658: Waiting for close lock at 1676153022328Disabling compacts and flushes for region at 1676153022328Disabling writes for close at 1676153022328Writing region close event to WAL at 1676153022328Closed at 1676153022328 2023-02-11 22:03:42,329 DEBUG [Listener at localhost/43127] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:42,329 INFO [Listener at localhost/43127] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:42,330 DEBUG [Listener at localhost/43127] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:42,332 INFO [StoreOpener-5174517129e32184c95d75c89c87312c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5174517129e32184c95d75c89c87312c 2023-02-11 22:03:42,333 DEBUG [StoreOpener-5174517129e32184c95d75c89c87312c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1 2023-02-11 22:03:42,333 INFO [StoreOpener-5174517129e32184c95d75c89c87312c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5174517129e32184c95d75c89c87312c columnFamilyName f1 2023-02-11 22:03:42,337 DEBUG [StoreOpener-5174517129e32184c95d75c89c87312c-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1/testWithMockedMapReduceMultiRegion=5174517129e32184c95d75c89c87312c-50f0e3c6df414de9af892ca75531060a 2023-02-11 22:03:42,337 INFO [StoreOpener-5174517129e32184c95d75c89c87312c-1] regionserver.HStore(310): Store=5174517129e32184c95d75c89c87312c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,337 INFO [StoreOpener-5174517129e32184c95d75c89c87312c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5174517129e32184c95d75c89c87312c 2023-02-11 22:03:42,337 DEBUG [StoreOpener-5174517129e32184c95d75c89c87312c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2 2023-02-11 22:03:42,338 INFO [StoreOpener-5174517129e32184c95d75c89c87312c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5174517129e32184c95d75c89c87312c columnFamilyName f2 2023-02-11 22:03:42,341 DEBUG [StoreOpener-5174517129e32184c95d75c89c87312c-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2/testWithMockedMapReduceMultiRegion=5174517129e32184c95d75c89c87312c-fb5ddeff2ec1451fb042f357a54d44b5 2023-02-11 22:03:42,341 INFO [StoreOpener-5174517129e32184c95d75c89c87312c-1] regionserver.HStore(310): Store=5174517129e32184c95d75c89c87312c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,341 DEBUG [Listener at localhost/43127] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:42,341 INFO [Listener at localhost/43127] regionserver.HRegion(1071): Opened 5174517129e32184c95d75c89c87312c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64496447, jitterRate=-0.03892804682254791}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:42,341 DEBUG [Listener at localhost/43127] regionserver.HRegion(964): Region open journal for 5174517129e32184c95d75c89c87312c: Writing region info on filesystem at 1676153022330Initializing all the Stores at 1676153022331 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022331Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022331Region opened successfully at 1676153022341 (+10 ms) 2023-02-11 22:03:42,349 DEBUG [Listener at localhost/43127] regionserver.HRegion(1603): Closing 5174517129e32184c95d75c89c87312c, disabling compactions & flushes 2023-02-11 22:03:42,350 INFO [Listener at localhost/43127] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:42,351 DEBUG [Listener at localhost/43127] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:42,351 DEBUG [Listener at localhost/43127] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. after waiting 0 ms 2023-02-11 22:03:42,351 DEBUG [Listener at localhost/43127] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:42,351 INFO [Listener at localhost/43127] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:42,351 DEBUG [Listener at localhost/43127] regionserver.HRegion(1557): Region close journal for 5174517129e32184c95d75c89c87312c: Waiting for close lock at 1676153022349Disabling compacts and flushes for region at 1676153022349Disabling writes for close at 1676153022351 (+2 ms)Writing region close event to WAL at 1676153022351Closed at 1676153022351 2023-02-11 22:03:42,352 DEBUG [Listener at localhost/43127] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:42,352 INFO [Listener at localhost/43127] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:42,353 DEBUG [Listener at localhost/43127] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:42,354 INFO [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:42,355 DEBUG [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/f1 2023-02-11 22:03:42,356 INFO [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b81c83bbc762e01c0d4687ecc3e4d5f columnFamilyName f1 2023-02-11 22:03:42,356 INFO [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] regionserver.HStore(310): Store=2b81c83bbc762e01c0d4687ecc3e4d5f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,356 INFO [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:42,357 DEBUG [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/f2 2023-02-11 22:03:42,357 INFO [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b81c83bbc762e01c0d4687ecc3e4d5f columnFamilyName f2 2023-02-11 22:03:42,358 INFO [StoreOpener-2b81c83bbc762e01c0d4687ecc3e4d5f-1] regionserver.HStore(310): Store=2b81c83bbc762e01c0d4687ecc3e4d5f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,358 DEBUG [Listener at localhost/43127] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:42,358 INFO [Listener at localhost/43127] regionserver.HRegion(1071): Opened 2b81c83bbc762e01c0d4687ecc3e4d5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67271146, jitterRate=0.0024181902408599854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:42,358 DEBUG [Listener at localhost/43127] regionserver.HRegion(964): Region open journal for 2b81c83bbc762e01c0d4687ecc3e4d5f: Writing region info on filesystem at 1676153022353Initializing all the Stores at 1676153022354 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022354Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022354Region opened successfully at 1676153022358 (+4 ms) 2023-02-11 22:03:42,358 DEBUG [Listener at localhost/43127] regionserver.HRegion(1603): Closing 2b81c83bbc762e01c0d4687ecc3e4d5f, disabling compactions & flushes 2023-02-11 22:03:42,358 INFO [Listener at localhost/43127] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:42,358 DEBUG [Listener at localhost/43127] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:42,358 DEBUG [Listener at localhost/43127] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. after waiting 0 ms 2023-02-11 22:03:42,358 DEBUG [Listener at localhost/43127] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:42,359 INFO [Listener at localhost/43127] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:42,359 DEBUG [Listener at localhost/43127] regionserver.HRegion(1557): Region close journal for 2b81c83bbc762e01c0d4687ecc3e4d5f: Waiting for close lock at 1676153022358Disabling compacts and flushes for region at 1676153022358Disabling writes for close at 1676153022358Writing region close event to WAL at 1676153022359 (+1 ms)Closed at 1676153022359 2023-02-11 22:03:42,359 DEBUG [Listener at localhost/43127] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:42,359 INFO [Listener at localhost/43127] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:42,360 DEBUG [Listener at localhost/43127] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:42,361 INFO [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:42,362 DEBUG [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1 2023-02-11 22:03:42,362 INFO [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d4b5ec17541030a2731619cc0c22131 columnFamilyName f1 2023-02-11 22:03:42,366 DEBUG [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1/testWithMockedMapReduceMultiRegion=5d4b5ec17541030a2731619cc0c22131-9fce42dc79a6424f84e5134e95a8f955 2023-02-11 22:03:42,366 INFO [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] regionserver.HStore(310): Store=5d4b5ec17541030a2731619cc0c22131/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,366 INFO [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:42,367 DEBUG [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2 2023-02-11 22:03:42,367 INFO [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d4b5ec17541030a2731619cc0c22131 columnFamilyName f2 2023-02-11 22:03:42,370 DEBUG [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2/testWithMockedMapReduceMultiRegion=5d4b5ec17541030a2731619cc0c22131-a0b63dec722b4d54bd43ae7c0f3f22a6 2023-02-11 22:03:42,370 INFO [StoreOpener-5d4b5ec17541030a2731619cc0c22131-1] regionserver.HStore(310): Store=5d4b5ec17541030a2731619cc0c22131/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,371 DEBUG [Listener at localhost/43127] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:42,371 INFO [Listener at localhost/43127] regionserver.HRegion(1071): Opened 5d4b5ec17541030a2731619cc0c22131; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66272739, jitterRate=-0.012459233403205872}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:42,371 DEBUG [Listener at localhost/43127] regionserver.HRegion(964): Region open journal for 5d4b5ec17541030a2731619cc0c22131: Writing region info on filesystem at 1676153022360Initializing all the Stores at 1676153022361 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022361Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022361Region opened successfully at 1676153022371 (+10 ms) 2023-02-11 22:03:42,379 DEBUG [Listener at localhost/43127] regionserver.HRegion(1603): Closing 5d4b5ec17541030a2731619cc0c22131, disabling compactions & flushes 2023-02-11 22:03:42,379 INFO [Listener at localhost/43127] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:42,379 DEBUG [Listener at localhost/43127] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:42,379 DEBUG [Listener at localhost/43127] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. after waiting 0 ms 2023-02-11 22:03:42,380 DEBUG [Listener at localhost/43127] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:42,380 INFO [Listener at localhost/43127] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:42,380 DEBUG [Listener at localhost/43127] regionserver.HRegion(1557): Region close journal for 5d4b5ec17541030a2731619cc0c22131: Waiting for close lock at 1676153022379Disabling compacts and flushes for region at 1676153022379Disabling writes for close at 1676153022380 (+1 ms)Writing region close event to WAL at 1676153022380Closed at 1676153022380 2023-02-11 22:03:42,381 DEBUG [Listener at localhost/43127] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:42,381 INFO [Listener at localhost/43127] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:42,383 DEBUG [Listener at localhost/43127] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:42,387 INFO [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:42,388 DEBUG [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1 2023-02-11 22:03:42,388 INFO [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ba50bc234474d8b78783b91ee87273b columnFamilyName f1 2023-02-11 22:03:42,392 DEBUG [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1/testWithMockedMapReduceMultiRegion=7ba50bc234474d8b78783b91ee87273b-2a5dcb65da254ff6aadc139ab1b71c3b 2023-02-11 22:03:42,392 INFO [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] regionserver.HStore(310): Store=7ba50bc234474d8b78783b91ee87273b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,392 INFO [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:42,393 DEBUG [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2 2023-02-11 22:03:42,393 INFO [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ba50bc234474d8b78783b91ee87273b columnFamilyName f2 2023-02-11 22:03:42,398 DEBUG [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2/testWithMockedMapReduceMultiRegion=7ba50bc234474d8b78783b91ee87273b-8c3e0365107e45b8b82c5dc9e58ca86e 2023-02-11 22:03:42,398 INFO [StoreOpener-7ba50bc234474d8b78783b91ee87273b-1] regionserver.HStore(310): Store=7ba50bc234474d8b78783b91ee87273b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,398 DEBUG [Listener at localhost/43127] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:42,399 INFO [Listener at localhost/43127] regionserver.HRegion(1071): Opened 7ba50bc234474d8b78783b91ee87273b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73302372, jitterRate=0.09229046106338501}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:42,399 DEBUG [Listener at localhost/43127] regionserver.HRegion(964): Region open journal for 7ba50bc234474d8b78783b91ee87273b: Writing region info on filesystem at 1676153022383Initializing all the Stores at 1676153022383Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022383Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022387 (+4 ms)Region opened successfully at 1676153022399 (+12 ms) 2023-02-11 22:03:42,408 DEBUG [Listener at localhost/43127] regionserver.HRegion(1603): Closing 7ba50bc234474d8b78783b91ee87273b, disabling compactions & flushes 2023-02-11 22:03:42,408 INFO [Listener at localhost/43127] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:42,408 DEBUG [Listener at localhost/43127] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:42,408 DEBUG [Listener at localhost/43127] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. after waiting 0 ms 2023-02-11 22:03:42,408 DEBUG [Listener at localhost/43127] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:42,409 INFO [Listener at localhost/43127] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:42,409 DEBUG [Listener at localhost/43127] regionserver.HRegion(1557): Region close journal for 7ba50bc234474d8b78783b91ee87273b: Waiting for close lock at 1676153022408Disabling compacts and flushes for region at 1676153022408Disabling writes for close at 1676153022408Writing region close event to WAL at 1676153022409 (+1 ms)Closed at 1676153022409 2023-02-11 22:03:42,409 DEBUG [Listener at localhost/43127] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:42,409 INFO [Listener at localhost/43127] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:42,412 DEBUG [Listener at localhost/43127] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:42,413 INFO [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:42,414 DEBUG [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1 2023-02-11 22:03:42,414 INFO [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd258983e5ed209f80e2edb232c68895 columnFamilyName f1 2023-02-11 22:03:42,418 DEBUG [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1/testWithMockedMapReduceMultiRegion=dd258983e5ed209f80e2edb232c68895-54bd82b444f7420bb22e1bd8aefd9b65 2023-02-11 22:03:42,418 INFO [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] regionserver.HStore(310): Store=dd258983e5ed209f80e2edb232c68895/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,419 INFO [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:42,419 DEBUG [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2 2023-02-11 22:03:42,420 INFO [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd258983e5ed209f80e2edb232c68895 columnFamilyName f2 2023-02-11 22:03:42,425 DEBUG [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2/testWithMockedMapReduceMultiRegion=dd258983e5ed209f80e2edb232c68895-a97703125b5442f8b6fa7382885b06d2 2023-02-11 22:03:42,425 INFO [StoreOpener-dd258983e5ed209f80e2edb232c68895-1] regionserver.HStore(310): Store=dd258983e5ed209f80e2edb232c68895/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,426 DEBUG [Listener at localhost/43127] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:42,426 INFO [Listener at localhost/43127] regionserver.HRegion(1071): Opened dd258983e5ed209f80e2edb232c68895; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61624545, jitterRate=-0.08172272145748138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:42,426 DEBUG [Listener at localhost/43127] regionserver.HRegion(964): Region open journal for dd258983e5ed209f80e2edb232c68895: Writing region info on filesystem at 1676153022412Initializing all the Stores at 1676153022413 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022413Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022413Region opened successfully at 1676153022426 (+13 ms) 2023-02-11 22:03:42,436 DEBUG [Listener at localhost/43127] regionserver.HRegion(1603): Closing dd258983e5ed209f80e2edb232c68895, disabling compactions & flushes 2023-02-11 22:03:42,436 INFO [Listener at localhost/43127] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:42,436 DEBUG [Listener at localhost/43127] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:42,436 DEBUG [Listener at localhost/43127] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. after waiting 0 ms 2023-02-11 22:03:42,436 DEBUG [Listener at localhost/43127] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:42,437 INFO [Listener at localhost/43127] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:42,437 DEBUG [Listener at localhost/43127] regionserver.HRegion(1557): Region close journal for dd258983e5ed209f80e2edb232c68895: Waiting for close lock at 1676153022436Disabling compacts and flushes for region at 1676153022436Disabling writes for close at 1676153022436Writing region close event to WAL at 1676153022437 (+1 ms)Closed at 1676153022437 2023-02-11 22:03:42,438 DEBUG [Listener at localhost/43127] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:42,438 INFO [Listener at localhost/43127] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:42,439 DEBUG [Listener at localhost/43127] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:42,441 INFO [StoreOpener-ad58de138d24248fca2e889393c1191d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:42,442 DEBUG [StoreOpener-ad58de138d24248fca2e889393c1191d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/f1 2023-02-11 22:03:42,443 INFO [StoreOpener-ad58de138d24248fca2e889393c1191d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad58de138d24248fca2e889393c1191d columnFamilyName f1 2023-02-11 22:03:42,443 INFO [StoreOpener-ad58de138d24248fca2e889393c1191d-1] regionserver.HStore(310): Store=ad58de138d24248fca2e889393c1191d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,443 INFO [StoreOpener-ad58de138d24248fca2e889393c1191d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:42,444 DEBUG [StoreOpener-ad58de138d24248fca2e889393c1191d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/f2 2023-02-11 22:03:42,445 INFO [StoreOpener-ad58de138d24248fca2e889393c1191d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad58de138d24248fca2e889393c1191d columnFamilyName f2 2023-02-11 22:03:42,445 INFO [StoreOpener-ad58de138d24248fca2e889393c1191d-1] regionserver.HStore(310): Store=ad58de138d24248fca2e889393c1191d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,445 DEBUG [Listener at localhost/43127] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:42,445 INFO [Listener at localhost/43127] regionserver.HRegion(1071): Opened ad58de138d24248fca2e889393c1191d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70169011, jitterRate=0.045599743723869324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:42,446 DEBUG [Listener at localhost/43127] regionserver.HRegion(964): Region open journal for ad58de138d24248fca2e889393c1191d: Writing region info on filesystem at 1676153022439Initializing all the Stores at 1676153022440 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022440Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022440Region opened successfully at 1676153022446 (+6 ms) 2023-02-11 22:03:42,446 DEBUG [Listener at localhost/43127] regionserver.HRegion(1603): Closing ad58de138d24248fca2e889393c1191d, disabling compactions & flushes 2023-02-11 22:03:42,446 INFO [Listener at localhost/43127] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:42,446 DEBUG [Listener at localhost/43127] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:42,446 DEBUG [Listener at localhost/43127] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. after waiting 0 ms 2023-02-11 22:03:42,446 DEBUG [Listener at localhost/43127] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:42,446 INFO [Listener at localhost/43127] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:42,446 DEBUG [Listener at localhost/43127] regionserver.HRegion(1557): Region close journal for ad58de138d24248fca2e889393c1191d: Waiting for close lock at 1676153022446Disabling compacts and flushes for region at 1676153022446Disabling writes for close at 1676153022446Writing region close event to WAL at 1676153022446Closed at 1676153022446 2023-02-11 22:03:42,447 DEBUG [Listener at localhost/43127] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:42,447 INFO [Listener at localhost/43127] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:42,450 DEBUG [Listener at localhost/43127] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:42,454 INFO [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:42,455 DEBUG [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1 2023-02-11 22:03:42,455 INFO [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc6dde637206fbcdc9221e940ba4c453 columnFamilyName f1 2023-02-11 22:03:42,460 DEBUG [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1/testWithMockedMapReduceMultiRegion=bc6dde637206fbcdc9221e940ba4c453-49d60a3b86ff4920b8a93c77bea1ff04 2023-02-11 22:03:42,461 INFO [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] regionserver.HStore(310): Store=bc6dde637206fbcdc9221e940ba4c453/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,461 INFO [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:42,461 DEBUG [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2 2023-02-11 22:03:42,462 INFO [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc6dde637206fbcdc9221e940ba4c453 columnFamilyName f2 2023-02-11 22:03:42,465 DEBUG [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2/testWithMockedMapReduceMultiRegion=bc6dde637206fbcdc9221e940ba4c453-a4de47c282d34e2cb308607d9406efa0 2023-02-11 22:03:42,465 INFO [StoreOpener-bc6dde637206fbcdc9221e940ba4c453-1] regionserver.HStore(310): Store=bc6dde637206fbcdc9221e940ba4c453/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,465 DEBUG [Listener at localhost/43127] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:42,465 INFO [Listener at localhost/43127] regionserver.HRegion(1071): Opened bc6dde637206fbcdc9221e940ba4c453; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70633954, jitterRate=0.052527934312820435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:42,465 DEBUG [Listener at localhost/43127] regionserver.HRegion(964): Region open journal for bc6dde637206fbcdc9221e940ba4c453: Writing region info on filesystem at 1676153022450Initializing all the Stores at 1676153022451 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022451Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022453 (+2 ms)Region opened successfully at 1676153022465 (+12 ms) 2023-02-11 22:03:42,503 DEBUG [Listener at localhost/43127] regionserver.HRegion(1603): Closing bc6dde637206fbcdc9221e940ba4c453, disabling compactions & flushes 2023-02-11 22:03:42,503 INFO [Listener at localhost/43127] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:42,503 DEBUG [Listener at localhost/43127] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:42,503 DEBUG [Listener at localhost/43127] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. after waiting 0 ms 2023-02-11 22:03:42,503 DEBUG [Listener at localhost/43127] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:42,507 INFO [Listener at localhost/43127] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:42,507 DEBUG [Listener at localhost/43127] regionserver.HRegion(1557): Region close journal for bc6dde637206fbcdc9221e940ba4c453: Waiting for close lock at 1676153022503Disabling compacts and flushes for region at 1676153022503Disabling writes for close at 1676153022503Writing region close event to WAL at 1676153022507 (+4 ms)Closed at 1676153022507 2023-02-11 22:03:42,508 DEBUG [Listener at localhost/43127] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:42,508 INFO [Listener at localhost/43127] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:42,512 DEBUG [Listener at localhost/43127] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:42,514 INFO [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:42,515 DEBUG [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1 2023-02-11 22:03:42,515 INFO [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c77a08c8939c5654bd5d2cdec1784dea columnFamilyName f1 2023-02-11 22:03:42,519 DEBUG [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1/testWithMockedMapReduceMultiRegion=c77a08c8939c5654bd5d2cdec1784dea-292ee2ac10ee41c2a828f6a8e08d3bb1 2023-02-11 22:03:42,519 INFO [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] regionserver.HStore(310): Store=c77a08c8939c5654bd5d2cdec1784dea/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,519 INFO [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:42,520 DEBUG [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2 2023-02-11 22:03:42,520 INFO [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c77a08c8939c5654bd5d2cdec1784dea columnFamilyName f2 2023-02-11 22:03:42,523 DEBUG [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] regionserver.HStore(539): loaded hdfs://localhost:36467/user/jenkins/test-data/bb1c13fb-0ff4-95d6-5478-c97e8245e840/testWithMockedMapReduceMultiRegion/1300abe7-5b94-487a-9436-10b250b956ee/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2/testWithMockedMapReduceMultiRegion=c77a08c8939c5654bd5d2cdec1784dea-83418beb454149e78465d95328420fca 2023-02-11 22:03:42,524 INFO [StoreOpener-c77a08c8939c5654bd5d2cdec1784dea-1] regionserver.HStore(310): Store=c77a08c8939c5654bd5d2cdec1784dea/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:42,524 DEBUG [Listener at localhost/43127] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:42,524 INFO [Listener at localhost/43127] regionserver.HRegion(1071): Opened c77a08c8939c5654bd5d2cdec1784dea; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60341163, jitterRate=-0.10084660351276398}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:42,524 DEBUG [Listener at localhost/43127] regionserver.HRegion(964): Region open journal for c77a08c8939c5654bd5d2cdec1784dea: Writing region info on filesystem at 1676153022512Initializing all the Stores at 1676153022513 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022513Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153022513Region opened successfully at 1676153022524 (+11 ms) 2023-02-11 22:03:42,532 DEBUG [Listener at localhost/43127] regionserver.HRegion(1603): Closing c77a08c8939c5654bd5d2cdec1784dea, disabling compactions & flushes 2023-02-11 22:03:42,532 INFO [Listener at localhost/43127] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:42,532 DEBUG [Listener at localhost/43127] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:42,532 DEBUG [Listener at localhost/43127] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. after waiting 0 ms 2023-02-11 22:03:42,532 DEBUG [Listener at localhost/43127] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:42,535 INFO [Listener at localhost/43127] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:42,535 DEBUG [Listener at localhost/43127] regionserver.HRegion(1557): Region close journal for c77a08c8939c5654bd5d2cdec1784dea: Waiting for close lock at 1676153022532Disabling compacts and flushes for region at 1676153022532Disabling writes for close at 1676153022532Writing region close event to WAL at 1676153022535 (+3 ms)Closed at 1676153022535 2023-02-11 22:03:42,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-11 22:03:42,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-11 22:03:42,543 INFO [Listener at localhost/43127] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-11 22:03:42,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMockedMapReduceMultiRegion 2023-02-11 22:03:42,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:42,546 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153022546"}]},"ts":"1676153022546"} 2023-02-11 22:03:42,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 22:03:42,548 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-11 22:03:42,549 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-11 22:03:42,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad58de138d24248fca2e889393c1191d, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=dd258983e5ed209f80e2edb232c68895, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c77a08c8939c5654bd5d2cdec1784dea, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc6dde637206fbcdc9221e940ba4c453, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5174517129e32184c95d75c89c87312c, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02600f2e0b4f2b3f77cf9f34dcd31cdd, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d4b5ec17541030a2731619cc0c22131, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ba50bc234474d8b78783b91ee87273b, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4c6bba163d882e30ed97ad7704071658, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2b81c83bbc762e01c0d4687ecc3e4d5f, UNASSIGN}] 2023-02-11 22:03:42,552 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=dd258983e5ed209f80e2edb232c68895, UNASSIGN 2023-02-11 22:03:42,552 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad58de138d24248fca2e889393c1191d, UNASSIGN 2023-02-11 22:03:42,552 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c77a08c8939c5654bd5d2cdec1784dea, UNASSIGN 2023-02-11 22:03:42,552 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2b81c83bbc762e01c0d4687ecc3e4d5f, UNASSIGN 2023-02-11 22:03:42,552 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc6dde637206fbcdc9221e940ba4c453, UNASSIGN 2023-02-11 22:03:42,552 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=dd258983e5ed209f80e2edb232c68895, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:42,552 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=ad58de138d24248fca2e889393c1191d, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:42,552 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c77a08c8939c5654bd5d2cdec1784dea, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:42,553 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676153022552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153022552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153022552"}]},"ts":"1676153022552"} 2023-02-11 22:03:42,552 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153022552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153022552"}]},"ts":"1676153022552"} 2023-02-11 22:03:42,553 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153022552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153022552"}]},"ts":"1676153022552"} 2023-02-11 22:03:42,553 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2b81c83bbc762e01c0d4687ecc3e4d5f, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:42,553 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676153022553"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153022553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153022553"}]},"ts":"1676153022553"} 2023-02-11 22:03:42,553 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=bc6dde637206fbcdc9221e940ba4c453, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:42,553 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022553"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153022553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153022553"}]},"ts":"1676153022553"} 2023-02-11 22:03:42,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=34, state=RUNNABLE; CloseRegionProcedure ad58de138d24248fca2e889393c1191d, server=jenkins-hbase9.apache.org,35641,1676153018101}] 2023-02-11 22:03:42,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=35, state=RUNNABLE; CloseRegionProcedure dd258983e5ed209f80e2edb232c68895, server=jenkins-hbase9.apache.org,45137,1676153018073}] 2023-02-11 22:03:42,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=36, state=RUNNABLE; CloseRegionProcedure c77a08c8939c5654bd5d2cdec1784dea, server=jenkins-hbase9.apache.org,35641,1676153018101}] 2023-02-11 22:03:42,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 2b81c83bbc762e01c0d4687ecc3e4d5f, server=jenkins-hbase9.apache.org,45137,1676153018073}] 2023-02-11 22:03:42,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=37, state=RUNNABLE; CloseRegionProcedure bc6dde637206fbcdc9221e940ba4c453, server=jenkins-hbase9.apache.org,45137,1676153018073}] 2023-02-11 22:03:42,559 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4c6bba163d882e30ed97ad7704071658, UNASSIGN 2023-02-11 22:03:42,560 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ba50bc234474d8b78783b91ee87273b, UNASSIGN 2023-02-11 22:03:42,560 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=4c6bba163d882e30ed97ad7704071658, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:42,560 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153022560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153022560"}]},"ts":"1676153022560"} 2023-02-11 22:03:42,560 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d4b5ec17541030a2731619cc0c22131, UNASSIGN 2023-02-11 22:03:42,561 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02600f2e0b4f2b3f77cf9f34dcd31cdd, UNASSIGN 2023-02-11 22:03:42,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 4c6bba163d882e30ed97ad7704071658, server=jenkins-hbase9.apache.org,35641,1676153018101}] 2023-02-11 22:03:42,561 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5174517129e32184c95d75c89c87312c, UNASSIGN 2023-02-11 22:03:42,561 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=7ba50bc234474d8b78783b91ee87273b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:42,562 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022561"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153022561"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153022561"}]},"ts":"1676153022561"} 2023-02-11 22:03:42,562 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5d4b5ec17541030a2731619cc0c22131, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:42,562 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153022562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153022562"}]},"ts":"1676153022562"} 2023-02-11 22:03:42,562 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=02600f2e0b4f2b3f77cf9f34dcd31cdd, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:42,562 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153022562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153022562"}]},"ts":"1676153022562"} 2023-02-11 22:03:42,562 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5174517129e32184c95d75c89c87312c, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:42,563 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676153019139.5174517129e32184c95d75c89c87312c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153022562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153022562"}]},"ts":"1676153022562"} 2023-02-11 22:03:42,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 7ba50bc234474d8b78783b91ee87273b, server=jenkins-hbase9.apache.org,45137,1676153018073}] 2023-02-11 22:03:42,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 5d4b5ec17541030a2731619cc0c22131, server=jenkins-hbase9.apache.org,35641,1676153018101}] 2023-02-11 22:03:42,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 02600f2e0b4f2b3f77cf9f34dcd31cdd, server=jenkins-hbase9.apache.org,45137,1676153018073}] 2023-02-11 22:03:42,568 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure 5174517129e32184c95d75c89c87312c, server=jenkins-hbase9.apache.org,35641,1676153018101}] 2023-02-11 22:03:42,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 22:03:42,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:42,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing ad58de138d24248fca2e889393c1191d, disabling compactions & flushes 2023-02-11 22:03:42,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:42,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:42,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. after waiting 0 ms 2023-02-11 22:03:42,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:42,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:42,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing dd258983e5ed209f80e2edb232c68895, disabling compactions & flushes 2023-02-11 22:03:42,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:42,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:42,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. after waiting 0 ms 2023-02-11 22:03:42,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:42,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 22:03:42,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d. 2023-02-11 22:03:42,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for ad58de138d24248fca2e889393c1191d: Waiting for close lock at 1676153022709Running coprocessor pre-close hooks at 1676153022709Disabling compacts and flushes for region at 1676153022709Disabling writes for close at 1676153022709Writing region close event to WAL at 1676153022710 (+1 ms)Running coprocessor post-close hooks at 1676153022713 (+3 ms)Closed at 1676153022714 (+1 ms) 2023-02-11 22:03:42,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:42,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895. 2023-02-11 22:03:42,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for dd258983e5ed209f80e2edb232c68895: Waiting for close lock at 1676153022710Running coprocessor pre-close hooks at 1676153022710Disabling compacts and flushes for region at 1676153022710Disabling writes for close at 1676153022710Writing region close event to WAL at 1676153022711 (+1 ms)Running coprocessor post-close hooks at 1676153022714 (+3 ms)Closed at 1676153022714 2023-02-11 22:03:42,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:42,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:42,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 4c6bba163d882e30ed97ad7704071658, disabling compactions & flushes 2023-02-11 22:03:42,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:42,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:42,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. after waiting 0 ms 2023-02-11 22:03:42,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:42,715 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=ad58de138d24248fca2e889393c1191d, regionState=CLOSED 2023-02-11 22:03:42,715 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676153022715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153022715"}]},"ts":"1676153022715"} 2023-02-11 22:03:42,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:42,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:42,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 2b81c83bbc762e01c0d4687ecc3e4d5f, disabling compactions & flushes 2023-02-11 22:03:42,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:42,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:42,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. after waiting 0 ms 2023-02-11 22:03:42,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:42,716 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=dd258983e5ed209f80e2edb232c68895, regionState=CLOSED 2023-02-11 22:03:42,716 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022716"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153022716"}]},"ts":"1676153022716"} 2023-02-11 22:03:42,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=34 2023-02-11 22:03:42,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=34, state=SUCCESS; CloseRegionProcedure ad58de138d24248fca2e889393c1191d, server=jenkins-hbase9.apache.org,35641,1676153018101 in 163 msec 2023-02-11 22:03:42,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 22:03:42,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=35 2023-02-11 22:03:42,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=35, state=SUCCESS; CloseRegionProcedure dd258983e5ed209f80e2edb232c68895, server=jenkins-hbase9.apache.org,45137,1676153018073 in 163 msec 2023-02-11 22:03:42,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f. 2023-02-11 22:03:42,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 2b81c83bbc762e01c0d4687ecc3e4d5f: Waiting for close lock at 1676153022716Running coprocessor pre-close hooks at 1676153022716Disabling compacts and flushes for region at 1676153022716Disabling writes for close at 1676153022716Writing region close event to WAL at 1676153022716Running coprocessor post-close hooks at 1676153022720 (+4 ms)Closed at 1676153022720 2023-02-11 22:03:42,720 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ad58de138d24248fca2e889393c1191d, UNASSIGN in 169 msec 2023-02-11 22:03:42,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=dd258983e5ed209f80e2edb232c68895, UNASSIGN in 170 msec 2023-02-11 22:03:42,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:42,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:42,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 02600f2e0b4f2b3f77cf9f34dcd31cdd, disabling compactions & flushes 2023-02-11 22:03:42,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:42,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:42,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. after waiting 0 ms 2023-02-11 22:03:42,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:42,722 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2b81c83bbc762e01c0d4687ecc3e4d5f, regionState=CLOSED 2023-02-11 22:03:42,722 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676153022722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153022722"}]},"ts":"1676153022722"} 2023-02-11 22:03:42,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-11 22:03:42,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 2b81c83bbc762e01c0d4687ecc3e4d5f, server=jenkins-hbase9.apache.org,45137,1676153018073 in 167 msec 2023-02-11 22:03:42,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:42,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:42,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658. 2023-02-11 22:03:42,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 4c6bba163d882e30ed97ad7704071658: Waiting for close lock at 1676153022715Running coprocessor pre-close hooks at 1676153022715Disabling compacts and flushes for region at 1676153022715Disabling writes for close at 1676153022715Writing region close event to WAL at 1676153022717 (+2 ms)Running coprocessor post-close hooks at 1676153022725 (+8 ms)Closed at 1676153022725 2023-02-11 22:03:42,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2b81c83bbc762e01c0d4687ecc3e4d5f, UNASSIGN in 174 msec 2023-02-11 22:03:42,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd. 2023-02-11 22:03:42,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 02600f2e0b4f2b3f77cf9f34dcd31cdd: Waiting for close lock at 1676153022721Running coprocessor pre-close hooks at 1676153022721Disabling compacts and flushes for region at 1676153022721Disabling writes for close at 1676153022722 (+1 ms)Writing region close event to WAL at 1676153022722Running coprocessor post-close hooks at 1676153022725 (+3 ms)Closed at 1676153022725 2023-02-11 22:03:42,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:42,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:42,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 5d4b5ec17541030a2731619cc0c22131, disabling compactions & flushes 2023-02-11 22:03:42,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:42,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:42,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. after waiting 0 ms 2023-02-11 22:03:42,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:42,727 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=4c6bba163d882e30ed97ad7704071658, regionState=CLOSED 2023-02-11 22:03:42,727 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153022727"}]},"ts":"1676153022727"} 2023-02-11 22:03:42,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:42,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:42,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 7ba50bc234474d8b78783b91ee87273b, disabling compactions & flushes 2023-02-11 22:03:42,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:42,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:42,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. after waiting 0 ms 2023-02-11 22:03:42,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:42,728 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=02600f2e0b4f2b3f77cf9f34dcd31cdd, regionState=CLOSED 2023-02-11 22:03:42,728 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153022728"}]},"ts":"1676153022728"} 2023-02-11 22:03:42,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-11 22:03:42,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 4c6bba163d882e30ed97ad7704071658, server=jenkins-hbase9.apache.org,35641,1676153018101 in 167 msec 2023-02-11 22:03:42,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4c6bba163d882e30ed97ad7704071658, UNASSIGN in 180 msec 2023-02-11 22:03:42,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:42,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-11 22:03:42,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 02600f2e0b4f2b3f77cf9f34dcd31cdd, server=jenkins-hbase9.apache.org,45137,1676153018073 in 167 msec 2023-02-11 22:03:42,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:42,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131. 2023-02-11 22:03:42,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 5d4b5ec17541030a2731619cc0c22131: Waiting for close lock at 1676153022726Running coprocessor pre-close hooks at 1676153022726Disabling compacts and flushes for region at 1676153022726Disabling writes for close at 1676153022727 (+1 ms)Writing region close event to WAL at 1676153022728 (+1 ms)Running coprocessor post-close hooks at 1676153022733 (+5 ms)Closed at 1676153022733 2023-02-11 22:03:42,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b. 2023-02-11 22:03:42,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 7ba50bc234474d8b78783b91ee87273b: Waiting for close lock at 1676153022727Running coprocessor pre-close hooks at 1676153022727Disabling compacts and flushes for region at 1676153022727Disabling writes for close at 1676153022728 (+1 ms)Writing region close event to WAL at 1676153022729 (+1 ms)Running coprocessor post-close hooks at 1676153022733 (+4 ms)Closed at 1676153022733 2023-02-11 22:03:42,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02600f2e0b4f2b3f77cf9f34dcd31cdd, UNASSIGN in 183 msec 2023-02-11 22:03:42,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:42,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 5174517129e32184c95d75c89c87312c 2023-02-11 22:03:42,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 5174517129e32184c95d75c89c87312c, disabling compactions & flushes 2023-02-11 22:03:42,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:42,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:42,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. after waiting 0 ms 2023-02-11 22:03:42,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:42,734 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5d4b5ec17541030a2731619cc0c22131, regionState=CLOSED 2023-02-11 22:03:42,734 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022734"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153022734"}]},"ts":"1676153022734"} 2023-02-11 22:03:42,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:42,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:42,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing bc6dde637206fbcdc9221e940ba4c453, disabling compactions & flushes 2023-02-11 22:03:42,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:42,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:42,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. after waiting 0 ms 2023-02-11 22:03:42,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:42,735 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=7ba50bc234474d8b78783b91ee87273b, regionState=CLOSED 2023-02-11 22:03:42,735 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022735"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153022735"}]},"ts":"1676153022735"} 2023-02-11 22:03:42,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-11 22:03:42,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 5d4b5ec17541030a2731619cc0c22131, server=jenkins-hbase9.apache.org,35641,1676153018101 in 172 msec 2023-02-11 22:03:42,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:42,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-11 22:03:42,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 7ba50bc234474d8b78783b91ee87273b, server=jenkins-hbase9.apache.org,45137,1676153018073 in 174 msec 2023-02-11 22:03:42,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c. 2023-02-11 22:03:42,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 5174517129e32184c95d75c89c87312c: Waiting for close lock at 1676153022734Running coprocessor pre-close hooks at 1676153022734Disabling compacts and flushes for region at 1676153022734Disabling writes for close at 1676153022734Writing region close event to WAL at 1676153022736 (+2 ms)Running coprocessor post-close hooks at 1676153022739 (+3 ms)Closed at 1676153022739 2023-02-11 22:03:42,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:42,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453. 2023-02-11 22:03:42,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for bc6dde637206fbcdc9221e940ba4c453: Waiting for close lock at 1676153022735Running coprocessor pre-close hooks at 1676153022735Disabling compacts and flushes for region at 1676153022735Disabling writes for close at 1676153022735Writing region close event to WAL at 1676153022736 (+1 ms)Running coprocessor post-close hooks at 1676153022740 (+4 ms)Closed at 1676153022740 2023-02-11 22:03:42,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d4b5ec17541030a2731619cc0c22131, UNASSIGN in 188 msec 2023-02-11 22:03:42,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7ba50bc234474d8b78783b91ee87273b, UNASSIGN in 189 msec 2023-02-11 22:03:42,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:42,743 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=bc6dde637206fbcdc9221e940ba4c453, regionState=CLOSED 2023-02-11 22:03:42,744 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022743"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153022743"}]},"ts":"1676153022743"} 2023-02-11 22:03:42,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 5174517129e32184c95d75c89c87312c 2023-02-11 22:03:42,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:42,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing c77a08c8939c5654bd5d2cdec1784dea, disabling compactions & flushes 2023-02-11 22:03:42,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:42,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:42,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. after waiting 0 ms 2023-02-11 22:03:42,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:42,744 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5174517129e32184c95d75c89c87312c, regionState=CLOSED 2023-02-11 22:03:42,744 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676153019139.5174517129e32184c95d75c89c87312c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153022744"}]},"ts":"1676153022744"} 2023-02-11 22:03:42,746 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=37 2023-02-11 22:03:42,746 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=37, state=SUCCESS; CloseRegionProcedure bc6dde637206fbcdc9221e940ba4c453, server=jenkins-hbase9.apache.org,45137,1676153018073 in 188 msec 2023-02-11 22:03:42,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-11 22:03:42,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure 5174517129e32184c95d75c89c87312c, server=jenkins-hbase9.apache.org,35641,1676153018101 in 178 msec 2023-02-11 22:03:42,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc6dde637206fbcdc9221e940ba4c453, UNASSIGN in 196 msec 2023-02-11 22:03:42,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5174517129e32184c95d75c89c87312c, UNASSIGN in 197 msec 2023-02-11 22:03:42,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:42,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea. 2023-02-11 22:03:42,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for c77a08c8939c5654bd5d2cdec1784dea: Waiting for close lock at 1676153022744Running coprocessor pre-close hooks at 1676153022744Disabling compacts and flushes for region at 1676153022744Disabling writes for close at 1676153022744Writing region close event to WAL at 1676153022745 (+1 ms)Running coprocessor post-close hooks at 1676153022749 (+4 ms)Closed at 1676153022749 2023-02-11 22:03:42,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:42,750 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c77a08c8939c5654bd5d2cdec1784dea, regionState=CLOSED 2023-02-11 22:03:42,750 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676153022750"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153022750"}]},"ts":"1676153022750"} 2023-02-11 22:03:42,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=36 2023-02-11 22:03:42,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=36, state=SUCCESS; CloseRegionProcedure c77a08c8939c5654bd5d2cdec1784dea, server=jenkins-hbase9.apache.org,35641,1676153018101 in 195 msec 2023-02-11 22:03:42,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=33 2023-02-11 22:03:42,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c77a08c8939c5654bd5d2cdec1784dea, UNASSIGN in 202 msec 2023-02-11 22:03:42,754 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153022754"}]},"ts":"1676153022754"} 2023-02-11 22:03:42,755 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-11 22:03:42,756 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-11 22:03:42,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 214 msec 2023-02-11 22:03:42,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 22:03:42,850 INFO [Listener at localhost/43127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-11 22:03:42,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testWithMockedMapReduceMultiRegion 2023-02-11 22:03:42,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:42,853 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:42,854 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:42,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 22:03:42,865 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:42,865 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:42,865 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:42,865 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:42,865 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:42,865 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c 2023-02-11 22:03:42,865 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:42,865 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:42,868 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/recovered.edits] 2023-02-11 22:03:42,869 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/f1, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/f2, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/recovered.edits] 2023-02-11 22:03:42,869 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/recovered.edits] 2023-02-11 22:03:42,870 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/recovered.edits] 2023-02-11 22:03:42,870 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/recovered.edits] 2023-02-11 22:03:42,870 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/recovered.edits] 2023-02-11 22:03:42,870 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/recovered.edits] 2023-02-11 22:03:42,870 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/recovered.edits] 2023-02-11 22:03:42,879 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1/0a8d56659d684a4c8daa134c368d3db3 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1/0a8d56659d684a4c8daa134c368d3db3 2023-02-11 22:03:42,880 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1/2a5dcb65da254ff6aadc139ab1b71c3b to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1/2a5dcb65da254ff6aadc139ab1b71c3b 2023-02-11 22:03:42,880 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1/180b3e8619214e6d8711c6c3aca94ec3 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1/180b3e8619214e6d8711c6c3aca94ec3 2023-02-11 22:03:42,881 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1/9fce42dc79a6424f84e5134e95a8f955 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f1/9fce42dc79a6424f84e5134e95a8f955 2023-02-11 22:03:42,882 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1/49d60a3b86ff4920b8a93c77bea1ff04 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1/49d60a3b86ff4920b8a93c77bea1ff04 2023-02-11 22:03:42,882 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1/3936008692944b53a679221a00d7df2b to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1/3936008692944b53a679221a00d7df2b 2023-02-11 22:03:42,882 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1/54bd82b444f7420bb22e1bd8aefd9b65 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1/54bd82b444f7420bb22e1bd8aefd9b65 2023-02-11 22:03:42,883 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1/1b33e17d98d74eabb5b28f58ae117456 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1/1b33e17d98d74eabb5b28f58ae117456 2023-02-11 22:03:42,883 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/recovered.edits/6.seqid to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d/recovered.edits/6.seqid 2023-02-11 22:03:42,883 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1/fd1a3197d5684d529b5a74da8dcfe327 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f1/fd1a3197d5684d529b5a74da8dcfe327 2023-02-11 22:03:42,884 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1/50f0e3c6df414de9af892ca75531060a to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f1/50f0e3c6df414de9af892ca75531060a 2023-02-11 22:03:42,884 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1/925c69115232431e8143135dd73fff46 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f1/925c69115232431e8143135dd73fff46 2023-02-11 22:03:42,885 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1/721a9f35b21e4dfab86f546bfabe7c3c to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f1/721a9f35b21e4dfab86f546bfabe7c3c 2023-02-11 22:03:42,885 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1/57f5102f63db4fd899b878882cbd0a3a to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f1/57f5102f63db4fd899b878882cbd0a3a 2023-02-11 22:03:42,885 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/ad58de138d24248fca2e889393c1191d 2023-02-11 22:03:42,885 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:42,886 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1/292ee2ac10ee41c2a828f6a8e08d3bb1 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f1/292ee2ac10ee41c2a828f6a8e08d3bb1 2023-02-11 22:03:42,887 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2/03faf0cb1c4e48899e0e504d19c840a2 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2/03faf0cb1c4e48899e0e504d19c840a2 2023-02-11 22:03:42,890 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/recovered.edits] 2023-02-11 22:03:42,890 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2/a0b63dec722b4d54bd43ae7c0f3f22a6 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/f2/a0b63dec722b4d54bd43ae7c0f3f22a6 2023-02-11 22:03:42,891 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2/64ea9f477de6444d9bc4561b3da23ae4 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2/64ea9f477de6444d9bc4561b3da23ae4 2023-02-11 22:03:42,895 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2/a97703125b5442f8b6fa7382885b06d2 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2/a97703125b5442f8b6fa7382885b06d2 2023-02-11 22:03:42,895 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2/dc1c5278f6394dc898e153f98e642228 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2/dc1c5278f6394dc898e153f98e642228 2023-02-11 22:03:42,896 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2/0f7d5eff81b24706aee1d2160ed22f71 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2/0f7d5eff81b24706aee1d2160ed22f71 2023-02-11 22:03:42,896 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2/2a0182b4464947b3b0b57011d80ca518 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2/2a0182b4464947b3b0b57011d80ca518 2023-02-11 22:03:42,897 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2/8c3e0365107e45b8b82c5dc9e58ca86e to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/f2/8c3e0365107e45b8b82c5dc9e58ca86e 2023-02-11 22:03:42,897 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2/d5cd9273a086406aa19a892c6c40fa7d to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/f2/d5cd9273a086406aa19a892c6c40fa7d 2023-02-11 22:03:42,897 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2/37e78557f02c4875857d42c9438e0720 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2/37e78557f02c4875857d42c9438e0720 2023-02-11 22:03:42,898 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2/2a3a243e70e44c68ac940b00d0944ff7 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/f2/2a3a243e70e44c68ac940b00d0944ff7 2023-02-11 22:03:42,898 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2/fb5ddeff2ec1451fb042f357a54d44b5 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/f2/fb5ddeff2ec1451fb042f357a54d44b5 2023-02-11 22:03:42,903 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/recovered.edits/12.seqid to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131/recovered.edits/12.seqid 2023-02-11 22:03:42,904 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2/a4de47c282d34e2cb308607d9406efa0 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/f2/a4de47c282d34e2cb308607d9406efa0 2023-02-11 22:03:42,904 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d4b5ec17541030a2731619cc0c22131 2023-02-11 22:03:42,904 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:42,905 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2/83418beb454149e78465d95328420fca to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/f2/83418beb454149e78465d95328420fca 2023-02-11 22:03:42,905 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1/da6234e0dff5421088f2468e01393da2 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1/da6234e0dff5421088f2468e01393da2 2023-02-11 22:03:42,908 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/f1, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/f2, FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/recovered.edits] 2023-02-11 22:03:42,908 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/recovered.edits/12.seqid to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b/recovered.edits/12.seqid 2023-02-11 22:03:42,909 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/recovered.edits/12.seqid to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895/recovered.edits/12.seqid 2023-02-11 22:03:42,909 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1/e511f80f623b4a46ba079e0eb3aa08f9 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f1/e511f80f623b4a46ba079e0eb3aa08f9 2023-02-11 22:03:42,909 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/recovered.edits/12.seqid to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd/recovered.edits/12.seqid 2023-02-11 22:03:42,910 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/7ba50bc234474d8b78783b91ee87273b 2023-02-11 22:03:42,910 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/dd258983e5ed209f80e2edb232c68895 2023-02-11 22:03:42,910 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/02600f2e0b4f2b3f77cf9f34dcd31cdd 2023-02-11 22:03:42,910 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/recovered.edits/12.seqid to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c/recovered.edits/12.seqid 2023-02-11 22:03:42,911 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/recovered.edits/12.seqid to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea/recovered.edits/12.seqid 2023-02-11 22:03:42,911 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/5174517129e32184c95d75c89c87312c 2023-02-11 22:03:42,912 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/recovered.edits/12.seqid to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453/recovered.edits/12.seqid 2023-02-11 22:03:42,912 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c77a08c8939c5654bd5d2cdec1784dea 2023-02-11 22:03:42,912 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc6dde637206fbcdc9221e940ba4c453 2023-02-11 22:03:42,914 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2/1e355acbb27f48038b6a6efb2302b484 to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2/1e355acbb27f48038b6a6efb2302b484 2023-02-11 22:03:42,916 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2/3b88b1754bf34fba935fd6c9abbced9d to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/f2/3b88b1754bf34fba935fd6c9abbced9d 2023-02-11 22:03:42,916 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/recovered.edits/6.seqid to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f/recovered.edits/6.seqid 2023-02-11 22:03:42,917 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/2b81c83bbc762e01c0d4687ecc3e4d5f 2023-02-11 22:03:42,919 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/recovered.edits/12.seqid to hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/archive/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658/recovered.edits/12.seqid 2023-02-11 22:03:42,919 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4c6bba163d882e30ed97ad7704071658 2023-02-11 22:03:42,919 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-11 22:03:42,922 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:42,925 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-11 22:03:42,928 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-11 22:03:42,929 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:42,929 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-11 22:03:42,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153022929"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:42,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153022929"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:42,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153022929"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:42,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153022929"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:42,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676153019139.5174517129e32184c95d75c89c87312c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153022929"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:42,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153022929"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:42,930 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153022929"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:42,930 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153022929"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:42,930 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153022929"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:42,930 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153022929"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:42,932 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-11 22:03:42,932 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ad58de138d24248fca2e889393c1191d, NAME => 'testWithMockedMapReduceMultiRegion,,1676153019139.ad58de138d24248fca2e889393c1191d.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => dd258983e5ed209f80e2edb232c68895, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676153019139.dd258983e5ed209f80e2edb232c68895.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => c77a08c8939c5654bd5d2cdec1784dea, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676153019139.c77a08c8939c5654bd5d2cdec1784dea.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => bc6dde637206fbcdc9221e940ba4c453, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676153019139.bc6dde637206fbcdc9221e940ba4c453.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 5174517129e32184c95d75c89c87312c, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676153019139.5174517129e32184c95d75c89c87312c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 02600f2e0b4f2b3f77cf9f34dcd31cdd, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676153019139.02600f2e0b4f2b3f77cf9f34dcd31cdd.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 5d4b5ec17541030a2731619cc0c22131, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676153019139.5d4b5ec17541030a2731619cc0c22131.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 7ba50bc234474d8b78783b91ee87273b, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676153019139.7ba50bc234474d8b78783b91ee87273b.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 4c6bba163d882e30ed97ad7704071658, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676153019139.4c6bba163d882e30ed97ad7704071658.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 2b81c83bbc762e01c0d4687ecc3e4d5f, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676153019139.2b81c83bbc762e01c0d4687ecc3e4d5f.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-11 22:03:42,932 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-11 22:03:42,932 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676153022932"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:42,933 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-11 22:03:42,935 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 22:03:42,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 84 msec 2023-02-11 22:03:42,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 22:03:42,956 INFO [Listener at localhost/43127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-11 22:03:42,956 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 22:03:42,956 INFO [Listener at localhost/43127] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 22:03:42,956 DEBUG [Listener at localhost/43127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18878f29 to 127.0.0.1:58447 2023-02-11 22:03:42,956 DEBUG [Listener at localhost/43127] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:42,956 DEBUG [Listener at localhost/43127] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 22:03:42,957 DEBUG [Listener at localhost/43127] util.JVMClusterUtil(257): Found active master hash=1966975976, stopped=false 2023-02-11 22:03:42,957 INFO [Listener at localhost/43127] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,35513,1676153018018 2023-02-11 22:03:42,959 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:42,959 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:42,959 INFO [Listener at localhost/43127] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 22:03:42,959 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:42,959 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:42,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:42,961 DEBUG [Listener at localhost/43127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3356ac23 to 127.0.0.1:58447 2023-02-11 22:03:42,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:42,961 DEBUG [Listener at localhost/43127] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:42,961 INFO [Listener at localhost/43127] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,45137,1676153018073' ***** 2023-02-11 22:03:42,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:42,961 INFO [Listener at localhost/43127] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:42,961 INFO [Listener at localhost/43127] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,35641,1676153018101' ***** 2023-02-11 22:03:42,961 INFO [Listener at localhost/43127] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:42,961 INFO [RS:0;jenkins-hbase9:45137] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:42,961 INFO [RS:0;jenkins-hbase9:45137] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:42,962 INFO [RS:0;jenkins-hbase9:45137] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:42,962 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:42,963 INFO [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(3304): Received CLOSE for 9d56d77650c9b6ce560336202ed7a4e9 2023-02-11 22:03:42,963 INFO [RS:1;jenkins-hbase9:35641] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:42,963 INFO [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:42,963 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:42,963 INFO [RS:1;jenkins-hbase9:35641] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:42,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 9d56d77650c9b6ce560336202ed7a4e9, disabling compactions & flushes 2023-02-11 22:03:42,963 DEBUG [RS:0;jenkins-hbase9:45137] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02791c42 to 127.0.0.1:58447 2023-02-11 22:03:42,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. 2023-02-11 22:03:42,964 INFO [RS:1;jenkins-hbase9:35641] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:42,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. 2023-02-11 22:03:42,964 DEBUG [RS:0;jenkins-hbase9:45137] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:42,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. after waiting 0 ms 2023-02-11 22:03:42,964 INFO [RS:1;jenkins-hbase9:35641] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:42,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. 2023-02-11 22:03:42,965 DEBUG [RS:1;jenkins-hbase9:35641] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10f13ee9 to 127.0.0.1:58447 2023-02-11 22:03:42,965 INFO [RS:0;jenkins-hbase9:45137] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:42,965 DEBUG [RS:1;jenkins-hbase9:35641] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:42,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 9d56d77650c9b6ce560336202ed7a4e9 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 22:03:42,965 INFO [RS:1;jenkins-hbase9:35641] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,35641,1676153018101; all regions closed. 2023-02-11 22:03:42,965 INFO [RS:0;jenkins-hbase9:45137] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:42,965 INFO [RS:0;jenkins-hbase9:45137] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:42,965 INFO [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 22:03:42,965 INFO [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-11 22:03:42,965 DEBUG [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1479): Online Regions={9d56d77650c9b6ce560336202ed7a4e9=hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9., 1588230740=hbase:meta,,1.1588230740} 2023-02-11 22:03:42,967 DEBUG [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1505): Waiting on 1588230740, 9d56d77650c9b6ce560336202ed7a4e9 2023-02-11 22:03:42,967 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:42,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:42,967 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:42,967 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:42,967 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:42,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-11 22:03:42,970 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/WALs/jenkins-hbase9.apache.org,35641,1676153018101/jenkins-hbase9.apache.org%2C35641%2C1676153018101.1676153019434 not finished, retry = 0 2023-02-11 22:03:42,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9/.tmp/info/49ce6b283b944f368cc09320c117aa01 2023-02-11 22:03:42,981 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/.tmp/info/e53afccacd4b4748a6a1005bad24a1b7 2023-02-11 22:03:42,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e53afccacd4b4748a6a1005bad24a1b7 2023-02-11 22:03:42,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9/.tmp/info/49ce6b283b944f368cc09320c117aa01 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9/info/49ce6b283b944f368cc09320c117aa01 2023-02-11 22:03:42,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9/info/49ce6b283b944f368cc09320c117aa01, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 22:03:42,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9d56d77650c9b6ce560336202ed7a4e9 in 24ms, sequenceid=6, compaction requested=false 2023-02-11 22:03:42,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/namespace/9d56d77650c9b6ce560336202ed7a4e9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 22:03:42,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. 2023-02-11 22:03:42,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 9d56d77650c9b6ce560336202ed7a4e9: Waiting for close lock at 1676153022963Running coprocessor pre-close hooks at 1676153022963Disabling compacts and flushes for region at 1676153022963Disabling writes for close at 1676153022965 (+2 ms)Obtaining lock to block concurrent updates at 1676153022965Preparing flush snapshotting stores in 9d56d77650c9b6ce560336202ed7a4e9 at 1676153022965Finished memstore snapshotting hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676153022965Flushing stores of hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. at 1676153022967 (+2 ms)Flushing 9d56d77650c9b6ce560336202ed7a4e9/info: creating writer at 1676153022967Flushing 9d56d77650c9b6ce560336202ed7a4e9/info: appending metadata at 1676153022971 (+4 ms)Flushing 9d56d77650c9b6ce560336202ed7a4e9/info: closing flushed file at 1676153022971Flushing 9d56d77650c9b6ce560336202ed7a4e9/info: reopening flushed file at 1676153022985 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9d56d77650c9b6ce560336202ed7a4e9 in 24ms, sequenceid=6, compaction requested=false at 1676153022989 (+4 ms)Writing region close event to WAL at 1676153022990 (+1 ms)Running coprocessor post-close hooks at 1676153022996 (+6 ms)Closed at 1676153022997 (+1 ms) 2023-02-11 22:03:42,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676153018674.9d56d77650c9b6ce560336202ed7a4e9. 2023-02-11 22:03:43,027 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:43,027 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:43,072 DEBUG [RS:1;jenkins-hbase9:35641] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/oldWALs 2023-02-11 22:03:43,072 INFO [RS:1;jenkins-hbase9:35641] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C35641%2C1676153018101:(num 1676153019434) 2023-02-11 22:03:43,072 DEBUG [RS:1;jenkins-hbase9:35641] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:43,072 INFO [RS:1;jenkins-hbase9:35641] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:43,072 INFO [RS:1;jenkins-hbase9:35641] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:43,072 INFO [RS:1;jenkins-hbase9:35641] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:43,072 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:43,072 INFO [RS:1;jenkins-hbase9:35641] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:43,072 INFO [RS:1;jenkins-hbase9:35641] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:43,073 INFO [RS:1;jenkins-hbase9:35641] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35641 2023-02-11 22:03:43,076 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:43,076 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:43,076 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:43,076 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35641,1676153018101 2023-02-11 22:03:43,077 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:43,077 ERROR [Listener at localhost/43127-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@435f180d rejected from java.util.concurrent.ThreadPoolExecutor@476094be[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:43,077 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,35641,1676153018101] 2023-02-11 22:03:43,077 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,35641,1676153018101; numProcessing=1 2023-02-11 22:03:43,078 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,35641,1676153018101 already deleted, retry=false 2023-02-11 22:03:43,078 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,35641,1676153018101 expired; onlineServers=1 2023-02-11 22:03:43,167 DEBUG [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 22:03:43,367 DEBUG [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 22:03:43,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/.tmp/rep_barrier/f2b70191ad764d2e83df99b508cc1ef4 2023-02-11 22:03:43,399 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2b70191ad764d2e83df99b508cc1ef4 2023-02-11 22:03:43,406 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/.tmp/table/21553bee57df459db773412c216f4aa1 2023-02-11 22:03:43,408 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-11 22:03:43,409 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-11 22:03:43,409 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21553bee57df459db773412c216f4aa1 2023-02-11 22:03:43,410 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/.tmp/info/e53afccacd4b4748a6a1005bad24a1b7 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/info/e53afccacd4b4748a6a1005bad24a1b7 2023-02-11 22:03:43,413 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e53afccacd4b4748a6a1005bad24a1b7 2023-02-11 22:03:43,413 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/info/e53afccacd4b4748a6a1005bad24a1b7, entries=30, sequenceid=57, filesize=8.3 K 2023-02-11 22:03:43,414 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/.tmp/rep_barrier/f2b70191ad764d2e83df99b508cc1ef4 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/rep_barrier/f2b70191ad764d2e83df99b508cc1ef4 2023-02-11 22:03:43,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2b70191ad764d2e83df99b508cc1ef4 2023-02-11 22:03:43,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/rep_barrier/f2b70191ad764d2e83df99b508cc1ef4, entries=10, sequenceid=57, filesize=6.1 K 2023-02-11 22:03:43,417 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/.tmp/table/21553bee57df459db773412c216f4aa1 as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/table/21553bee57df459db773412c216f4aa1 2023-02-11 22:03:43,420 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21553bee57df459db773412c216f4aa1 2023-02-11 22:03:43,421 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/table/21553bee57df459db773412c216f4aa1, entries=13, sequenceid=57, filesize=6.1 K 2023-02-11 22:03:43,421 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 454ms, sequenceid=57, compaction requested=false 2023-02-11 22:03:43,425 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-11 22:03:43,425 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 22:03:43,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:43,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153022965Running coprocessor pre-close hooks at 1676153022965Disabling compacts and flushes for region at 1676153022965Disabling writes for close at 1676153022967 (+2 ms)Obtaining lock to block concurrent updates at 1676153022968 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676153022968Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676153022968Flushing stores of hbase:meta,,1.1588230740 at 1676153022969 (+1 ms)Flushing 1588230740/info: creating writer at 1676153022969Flushing 1588230740/info: appending metadata at 1676153022972 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676153022972Flushing 1588230740/rep_barrier: creating writer at 1676153022984 (+12 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676153022986 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676153022986Flushing 1588230740/table: creating writer at 1676153023400 (+414 ms)Flushing 1588230740/table: appending metadata at 1676153023401 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676153023401Flushing 1588230740/info: reopening flushed file at 1676153023410 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676153023414 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676153023418 (+4 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 454ms, sequenceid=57, compaction requested=false at 1676153023421 (+3 ms)Writing region close event to WAL at 1676153023422 (+1 ms)Running coprocessor post-close hooks at 1676153023425 (+3 ms)Closed at 1676153023426 (+1 ms) 2023-02-11 22:03:43,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:43,460 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:43,460 INFO [RS:1;jenkins-hbase9:35641] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,35641,1676153018101; zookeeper connection closed. 2023-02-11 22:03:43,460 ERROR [Listener at localhost/43127-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@80efb3b rejected from java.util.concurrent.ThreadPoolExecutor@476094be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:43,461 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:35641-0x100456a367d0002, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:43,461 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@67d87035] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@67d87035 2023-02-11 22:03:43,461 ERROR [Listener at localhost/43127-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@70aca2f8 rejected from java.util.concurrent.ThreadPoolExecutor@476094be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:43,568 INFO [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,45137,1676153018073; all regions closed. 2023-02-11 22:03:43,574 DEBUG [RS:0;jenkins-hbase9:45137] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/oldWALs 2023-02-11 22:03:43,574 INFO [RS:0;jenkins-hbase9:45137] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45137%2C1676153018073.meta:.meta(num 1676153018624) 2023-02-11 22:03:43,578 DEBUG [RS:0;jenkins-hbase9:45137] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/oldWALs 2023-02-11 22:03:43,578 INFO [RS:0;jenkins-hbase9:45137] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45137%2C1676153018073:(num 1676153019036) 2023-02-11 22:03:43,578 DEBUG [RS:0;jenkins-hbase9:45137] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:43,578 INFO [RS:0;jenkins-hbase9:45137] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:43,578 INFO [RS:0;jenkins-hbase9:45137] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:43,578 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:43,579 INFO [RS:0;jenkins-hbase9:45137] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45137 2023-02-11 22:03:43,583 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45137,1676153018073 2023-02-11 22:03:43,583 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:43,584 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,45137,1676153018073] 2023-02-11 22:03:43,584 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,45137,1676153018073; numProcessing=2 2023-02-11 22:03:43,585 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,45137,1676153018073 already deleted, retry=false 2023-02-11 22:03:43,585 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,45137,1676153018073 expired; onlineServers=0 2023-02-11 22:03:43,585 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,35513,1676153018018' ***** 2023-02-11 22:03:43,585 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 22:03:43,586 DEBUG [M:0;jenkins-hbase9:35513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71023197, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:43,586 INFO [M:0;jenkins-hbase9:35513] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,35513,1676153018018 2023-02-11 22:03:43,586 INFO [M:0;jenkins-hbase9:35513] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,35513,1676153018018; all regions closed. 2023-02-11 22:03:43,586 DEBUG [M:0;jenkins-hbase9:35513] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:43,586 DEBUG [M:0;jenkins-hbase9:35513] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 22:03:43,586 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 22:03:43,586 DEBUG [M:0;jenkins-hbase9:35513] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 22:03:43,586 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153018267] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153018267,5,FailOnTimeoutGroup] 2023-02-11 22:03:43,586 INFO [M:0;jenkins-hbase9:35513] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 22:03:43,586 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153018265] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153018265,5,FailOnTimeoutGroup] 2023-02-11 22:03:43,587 INFO [M:0;jenkins-hbase9:35513] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 22:03:43,588 INFO [M:0;jenkins-hbase9:35513] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-11 22:03:43,588 DEBUG [M:0;jenkins-hbase9:35513] master.HMaster(1502): Stopping service threads 2023-02-11 22:03:43,588 INFO [M:0;jenkins-hbase9:35513] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 22:03:43,588 ERROR [M:0;jenkins-hbase9:35513] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 22:03:43,588 INFO [M:0;jenkins-hbase9:35513] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 22:03:43,589 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 22:03:43,593 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:43,593 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:43,593 DEBUG [M:0;jenkins-hbase9:35513] zookeeper.ZKUtil(398): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 22:03:43,593 WARN [M:0;jenkins-hbase9:35513] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 22:03:43,593 INFO [M:0;jenkins-hbase9:35513] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 22:03:43,594 INFO [M:0;jenkins-hbase9:35513] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 22:03:43,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:43,594 DEBUG [M:0;jenkins-hbase9:35513] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:43,594 INFO [M:0;jenkins-hbase9:35513] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:43,594 DEBUG [M:0;jenkins-hbase9:35513] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:43,594 DEBUG [M:0;jenkins-hbase9:35513] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:43,594 DEBUG [M:0;jenkins-hbase9:35513] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:43,594 INFO [M:0;jenkins-hbase9:35513] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.10 KB heapSize=200.02 KB 2023-02-11 22:03:43,605 INFO [M:0;jenkins-hbase9:35513] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.10 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/473bd774ec0d4cd8b2372611117e641d 2023-02-11 22:03:43,608 DEBUG [M:0;jenkins-hbase9:35513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/473bd774ec0d4cd8b2372611117e641d as hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/473bd774ec0d4cd8b2372611117e641d 2023-02-11 22:03:43,612 INFO [M:0;jenkins-hbase9:35513] regionserver.HStore(1080): Added hdfs://localhost:36467/user/jenkins/test-data/2987c614-3a36-bdbd-54d2-3d5376c4f02d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/473bd774ec0d4cd8b2372611117e641d, entries=53, sequenceid=357, filesize=10.7 K 2023-02-11 22:03:43,613 INFO [M:0;jenkins-hbase9:35513] regionserver.HRegion(2947): Finished flush of dataSize ~167.10 KB/171111, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=357, compaction requested=false 2023-02-11 22:03:43,613 INFO [M:0;jenkins-hbase9:35513] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:43,613 DEBUG [M:0;jenkins-hbase9:35513] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153023594Disabling compacts and flushes for region at 1676153023594Disabling writes for close at 1676153023594Obtaining lock to block concurrent updates at 1676153023594Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676153023594Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171111, getHeapSize=204800, getOffHeapSize=0, getCellsCount=442 at 1676153023594Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676153023595 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676153023596 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676153023598 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676153023598Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676153023609 (+11 ms)Finished flush of dataSize ~167.10 KB/171111, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=357, compaction requested=false at 1676153023613 (+4 ms)Writing region close event to WAL at 1676153023613Closed at 1676153023613 2023-02-11 22:03:43,616 INFO [M:0;jenkins-hbase9:35513] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 22:03:43,616 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:43,617 INFO [M:0;jenkins-hbase9:35513] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35513 2023-02-11 22:03:43,619 DEBUG [M:0;jenkins-hbase9:35513] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,35513,1676153018018 already deleted, retry=false 2023-02-11 22:03:43,684 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:43,684 INFO [RS:0;jenkins-hbase9:45137] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,45137,1676153018073; zookeeper connection closed. 2023-02-11 22:03:43,684 ERROR [Listener at localhost/43127-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7c8b718a rejected from java.util.concurrent.ThreadPoolExecutor@78b4fac3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:43,685 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): regionserver:45137-0x100456a367d0001, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:43,685 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3c72ad59] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3c72ad59 2023-02-11 22:03:43,685 ERROR [Listener at localhost/43127-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2be1b4bd rejected from java.util.concurrent.ThreadPoolExecutor@78b4fac3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:43,685 INFO [Listener at localhost/43127] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 22:03:43,785 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:43,785 INFO [M:0;jenkins-hbase9:35513] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,35513,1676153018018; zookeeper connection closed. 2023-02-11 22:03:43,785 ERROR [Listener at localhost/43127-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43aaeaf8 rejected from java.util.concurrent.ThreadPoolExecutor@47956655[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:43,786 DEBUG [Listener at localhost/43127-EventThread] zookeeper.ZKWatcher(600): master:35513-0x100456a367d0000, quorum=127.0.0.1:58447, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:43,786 WARN [Listener at localhost/43127] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:43,786 ERROR [Listener at localhost/43127-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2736c191 rejected from java.util.concurrent.ThreadPoolExecutor@47956655[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:43,790 INFO [Listener at localhost/43127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:43,897 WARN [BP-1893118487-172.31.2.10-1676153017434 heartbeating to localhost/127.0.0.1:36467] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:43,897 WARN [BP-1893118487-172.31.2.10-1676153017434 heartbeating to localhost/127.0.0.1:36467] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1893118487-172.31.2.10-1676153017434 (Datanode Uuid 8382ec63-3454-43cc-b2db-819efc7b6815) service to localhost/127.0.0.1:36467 2023-02-11 22:03:43,898 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/cluster_9dac571f-6391-e26e-ddfd-bedff2be36e5/dfs/data/data3/current/BP-1893118487-172.31.2.10-1676153017434] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:43,898 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/cluster_9dac571f-6391-e26e-ddfd-bedff2be36e5/dfs/data/data4/current/BP-1893118487-172.31.2.10-1676153017434] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:43,899 WARN [Listener at localhost/43127] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:43,902 INFO [Listener at localhost/43127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:44,009 WARN [BP-1893118487-172.31.2.10-1676153017434 heartbeating to localhost/127.0.0.1:36467] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:44,010 WARN [BP-1893118487-172.31.2.10-1676153017434 heartbeating to localhost/127.0.0.1:36467] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1893118487-172.31.2.10-1676153017434 (Datanode Uuid 2a65c097-69ae-4efc-bc8b-b22e71691aa5) service to localhost/127.0.0.1:36467 2023-02-11 22:03:44,013 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/cluster_9dac571f-6391-e26e-ddfd-bedff2be36e5/dfs/data/data1/current/BP-1893118487-172.31.2.10-1676153017434] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:44,013 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/cluster_9dac571f-6391-e26e-ddfd-bedff2be36e5/dfs/data/data2/current/BP-1893118487-172.31.2.10-1676153017434] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:44,025 INFO [Listener at localhost/43127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:44,144 INFO [Listener at localhost/43127] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 22:03:44,180 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 22:03:44,195 INFO [Listener at localhost/43127] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=227 (was 177) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43127.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/43127.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:36467 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43127.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:36467 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/43127.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,35513,1676153018018)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43127 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:36467 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43127.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:36467 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36467 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43127.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43127.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:36467 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:36467 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43127.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/43127.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/43127.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=634 (was 564) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=302 (was 285) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=9645 (was 9699) 2023-02-11 22:03:44,205 INFO [Listener at localhost/43127] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=227, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=302, ProcessCount=166, AvailableMemoryMB=9645 2023-02-11 22:03:44,215 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/hadoop.log.dir so I do NOT create it in target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8 2023-02-11 22:03:44,215 WARN [Listener at localhost/43127] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 22:03:44,215 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/hadoop.tmp.dir so I do NOT create it in target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8 2023-02-11 22:03:44,215 WARN [Listener at localhost/43127] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/829b629e-3ba9-a453-756e-21c195c43def/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 22:03:44,215 DEBUG [Listener at localhost/43127] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8 2023-02-11 22:03:44,215 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 22:03:44,216 INFO [Listener at localhost/43127] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/cluster_52d53346-f170-5af0-daff-196782343850, deleteOnExit=true 2023-02-11 22:03:44,216 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 22:03:44,216 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/test.cache.data in system properties and HBase conf 2023-02-11 22:03:44,216 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 22:03:44,216 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/hadoop.log.dir in system properties and HBase conf 2023-02-11 22:03:44,216 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 22:03:44,216 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 22:03:44,216 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 22:03:44,216 DEBUG [Listener at localhost/43127] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 22:03:44,216 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:44,217 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:44,217 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 22:03:44,217 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:44,217 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 22:03:44,217 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 22:03:44,217 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:44,217 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:44,217 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 22:03:44,217 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/nfs.dump.dir in system properties and HBase conf 2023-02-11 22:03:44,217 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/java.io.tmpdir in system properties and HBase conf 2023-02-11 22:03:44,217 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:44,218 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 22:03:44,218 INFO [Listener at localhost/43127] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 22:03:44,247 WARN [Listener at localhost/43127] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:44,248 WARN [Listener at localhost/43127] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:44,290 WARN [Listener at localhost/43127] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-11 22:03:44,376 WARN [Listener at localhost/43127] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:44,378 INFO [Listener at localhost/43127] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:44,383 INFO [Listener at localhost/43127] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/java.io.tmpdir/Jetty_localhost_44117_hdfs____nz2ce9/webapp 2023-02-11 22:03:44,473 INFO [Listener at localhost/43127] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44117 2023-02-11 22:03:44,478 WARN [Listener at localhost/43127] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:44,478 WARN [Listener at localhost/43127] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:44,520 WARN [Listener at localhost/41845] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:44,533 WARN [Listener at localhost/41845] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:44,535 WARN [Listener at localhost/41845] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:44,536 INFO [Listener at localhost/41845] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:44,541 INFO [Listener at localhost/41845] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/java.io.tmpdir/Jetty_localhost_43921_datanode____.mguk3k/webapp 2023-02-11 22:03:44,632 INFO [Listener at localhost/41845] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43921 2023-02-11 22:03:44,642 WARN [Listener at localhost/36445] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:44,662 WARN [Listener at localhost/36445] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:44,664 WARN [Listener at localhost/36445] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:44,665 INFO [Listener at localhost/36445] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:44,669 INFO [Listener at localhost/36445] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/java.io.tmpdir/Jetty_localhost_35165_datanode____.tx84cr/webapp 2023-02-11 22:03:44,750 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf3a0dd2c4079214: Processing first storage report for DS-886e7a13-b92c-48c3-aa61-66c254acb427 from datanode bc411d7c-bf34-4698-9624-be8b2519af14 2023-02-11 22:03:44,750 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf3a0dd2c4079214: from storage DS-886e7a13-b92c-48c3-aa61-66c254acb427 node DatanodeRegistration(127.0.0.1:44175, datanodeUuid=bc411d7c-bf34-4698-9624-be8b2519af14, infoPort=33301, infoSecurePort=0, ipcPort=36445, storageInfo=lv=-57;cid=testClusterID;nsid=1144630224;c=1676153024250), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:44,750 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf3a0dd2c4079214: Processing first storage report for DS-cc33deb3-d4bd-4b72-811e-f3761e010ac6 from datanode bc411d7c-bf34-4698-9624-be8b2519af14 2023-02-11 22:03:44,750 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf3a0dd2c4079214: from storage DS-cc33deb3-d4bd-4b72-811e-f3761e010ac6 node DatanodeRegistration(127.0.0.1:44175, datanodeUuid=bc411d7c-bf34-4698-9624-be8b2519af14, infoPort=33301, infoSecurePort=0, ipcPort=36445, storageInfo=lv=-57;cid=testClusterID;nsid=1144630224;c=1676153024250), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:44,781 INFO [Listener at localhost/36445] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35165 2023-02-11 22:03:44,792 WARN [Listener at localhost/45513] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:44,905 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7d4a7b5b0b9bf1b4: Processing first storage report for DS-d9a89d10-6dc6-4638-b7e4-66aff080e7be from datanode 7efd3b99-efbe-4702-a5fd-1aca2c528797 2023-02-11 22:03:44,905 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7d4a7b5b0b9bf1b4: from storage DS-d9a89d10-6dc6-4638-b7e4-66aff080e7be node DatanodeRegistration(127.0.0.1:44783, datanodeUuid=7efd3b99-efbe-4702-a5fd-1aca2c528797, infoPort=37071, infoSecurePort=0, ipcPort=45513, storageInfo=lv=-57;cid=testClusterID;nsid=1144630224;c=1676153024250), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:44,906 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7d4a7b5b0b9bf1b4: Processing first storage report for DS-9728e4fc-070e-4c12-bd24-a5a53230567c from datanode 7efd3b99-efbe-4702-a5fd-1aca2c528797 2023-02-11 22:03:44,906 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7d4a7b5b0b9bf1b4: from storage DS-9728e4fc-070e-4c12-bd24-a5a53230567c node DatanodeRegistration(127.0.0.1:44783, datanodeUuid=7efd3b99-efbe-4702-a5fd-1aca2c528797, infoPort=37071, infoSecurePort=0, ipcPort=45513, storageInfo=lv=-57;cid=testClusterID;nsid=1144630224;c=1676153024250), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:45,002 DEBUG [Listener at localhost/45513] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8 2023-02-11 22:03:45,004 INFO [Listener at localhost/45513] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/cluster_52d53346-f170-5af0-daff-196782343850/zookeeper_0, clientPort=53693, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/cluster_52d53346-f170-5af0-daff-196782343850/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/cluster_52d53346-f170-5af0-daff-196782343850/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 22:03:45,005 INFO [Listener at localhost/45513] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53693 2023-02-11 22:03:45,006 INFO [Listener at localhost/45513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:45,006 INFO [Listener at localhost/45513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:45,018 INFO [Listener at localhost/45513] util.FSUtils(479): Created version file at hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf with version=8 2023-02-11 22:03:45,018 INFO [Listener at localhost/45513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:45,020 INFO [Listener at localhost/45513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:45,021 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41845/user/jenkins/test-data/ea24cc2f-8b4c-fee8-164f-8498ec114b9b/hbase-staging 2023-02-11 22:03:45,023 INFO [Listener at localhost/45513] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:45,023 INFO [Listener at localhost/45513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:45,023 INFO [Listener at localhost/45513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:45,023 INFO [Listener at localhost/45513] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:45,024 INFO [Listener at localhost/45513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:45,024 INFO [Listener at localhost/45513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:45,024 INFO [Listener at localhost/45513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:45,024 INFO [Listener at localhost/45513] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41571 2023-02-11 22:03:45,025 INFO [Listener at localhost/45513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:45,026 INFO [Listener at localhost/45513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:45,027 INFO [Listener at localhost/45513] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41571 connecting to ZooKeeper ensemble=127.0.0.1:53693 2023-02-11 22:03:45,038 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:415710x0, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:45,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41571-0x100456a51da0000 connected 2023-02-11 22:03:45,054 DEBUG [Listener at localhost/45513] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:45,054 DEBUG [Listener at localhost/45513] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:45,055 DEBUG [Listener at localhost/45513] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:45,059 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41571 2023-02-11 22:03:45,059 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41571 2023-02-11 22:03:45,060 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41571 2023-02-11 22:03:45,060 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41571 2023-02-11 22:03:45,060 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41571 2023-02-11 22:03:45,060 INFO [Listener at localhost/45513] master.HMaster(439): hbase.rootdir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf, hbase.cluster.distributed=false 2023-02-11 22:03:45,073 INFO [Listener at localhost/45513] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:45,073 INFO [Listener at localhost/45513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:45,073 INFO [Listener at localhost/45513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:45,073 INFO [Listener at localhost/45513] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:45,073 INFO [Listener at localhost/45513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:45,073 INFO [Listener at localhost/45513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:45,073 INFO [Listener at localhost/45513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:45,074 INFO [Listener at localhost/45513] ipc.NettyRpcServer(120): Bind to /172.31.2.10:37599 2023-02-11 22:03:45,074 INFO [Listener at localhost/45513] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:45,076 DEBUG [Listener at localhost/45513] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:45,077 INFO [Listener at localhost/45513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:45,078 INFO [Listener at localhost/45513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:45,079 INFO [Listener at localhost/45513] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37599 connecting to ZooKeeper ensemble=127.0.0.1:53693 2023-02-11 22:03:45,082 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:375990x0, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:45,083 DEBUG [Listener at localhost/45513] zookeeper.ZKUtil(164): regionserver:375990x0, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:45,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37599-0x100456a51da0001 connected 2023-02-11 22:03:45,084 DEBUG [Listener at localhost/45513] zookeeper.ZKUtil(164): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:45,085 DEBUG [Listener at localhost/45513] zookeeper.ZKUtil(164): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:45,085 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37599 2023-02-11 22:03:45,085 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37599 2023-02-11 22:03:45,089 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37599 2023-02-11 22:03:45,090 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37599 2023-02-11 22:03:45,090 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37599 2023-02-11 22:03:45,101 INFO [Listener at localhost/45513] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:45,101 INFO [Listener at localhost/45513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:45,101 INFO [Listener at localhost/45513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:45,101 INFO [Listener at localhost/45513] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:45,101 INFO [Listener at localhost/45513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:45,101 INFO [Listener at localhost/45513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:45,102 INFO [Listener at localhost/45513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:45,102 INFO [Listener at localhost/45513] ipc.NettyRpcServer(120): Bind to /172.31.2.10:44297 2023-02-11 22:03:45,103 INFO [Listener at localhost/45513] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:45,103 DEBUG [Listener at localhost/45513] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:45,103 INFO [Listener at localhost/45513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:45,104 INFO [Listener at localhost/45513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:45,105 INFO [Listener at localhost/45513] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44297 connecting to ZooKeeper ensemble=127.0.0.1:53693 2023-02-11 22:03:45,109 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:442970x0, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:45,110 DEBUG [Listener at localhost/45513] zookeeper.ZKUtil(164): regionserver:442970x0, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:45,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44297-0x100456a51da0002 connected 2023-02-11 22:03:45,110 DEBUG [Listener at localhost/45513] zookeeper.ZKUtil(164): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:45,111 DEBUG [Listener at localhost/45513] zookeeper.ZKUtil(164): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:45,115 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44297 2023-02-11 22:03:45,115 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44297 2023-02-11 22:03:45,115 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44297 2023-02-11 22:03:45,117 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44297 2023-02-11 22:03:45,118 DEBUG [Listener at localhost/45513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44297 2023-02-11 22:03:45,120 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,41571,1676153025022 2023-02-11 22:03:45,121 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:45,121 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,41571,1676153025022 2023-02-11 22:03:45,124 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:45,124 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:45,124 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:45,124 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:45,125 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:45,127 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,41571,1676153025022 from backup master directory 2023-02-11 22:03:45,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:45,128 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,41571,1676153025022 2023-02-11 22:03:45,128 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:45,128 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:45,128 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,41571,1676153025022 2023-02-11 22:03:45,139 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/hbase.id with ID: f3e01893-3cb4-478d-bb19-1937d0fa31eb 2023-02-11 22:03:45,147 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:45,149 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:45,158 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6be4d638 to 127.0.0.1:53693 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:45,164 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c056ea8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:45,164 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:45,165 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 22:03:45,167 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:45,168 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/data/master/store-tmp 2023-02-11 22:03:45,177 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:45,178 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:45,178 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:45,178 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:45,178 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:45,178 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:45,178 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:45,178 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153025178Disabling compacts and flushes for region at 1676153025178Disabling writes for close at 1676153025178Writing region close event to WAL at 1676153025178Closed at 1676153025178 2023-02-11 22:03:45,178 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/WALs/jenkins-hbase9.apache.org,41571,1676153025022 2023-02-11 22:03:45,180 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41571%2C1676153025022, suffix=, logDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/WALs/jenkins-hbase9.apache.org,41571,1676153025022, archiveDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/oldWALs, maxLogs=10 2023-02-11 22:03:45,193 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44175,DS-886e7a13-b92c-48c3-aa61-66c254acb427,DISK] 2023-02-11 22:03:45,193 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44783,DS-d9a89d10-6dc6-4638-b7e4-66aff080e7be,DISK] 2023-02-11 22:03:45,195 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/WALs/jenkins-hbase9.apache.org,41571,1676153025022/jenkins-hbase9.apache.org%2C41571%2C1676153025022.1676153025180 2023-02-11 22:03:45,195 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44175,DS-886e7a13-b92c-48c3-aa61-66c254acb427,DISK], DatanodeInfoWithStorage[127.0.0.1:44783,DS-d9a89d10-6dc6-4638-b7e4-66aff080e7be,DISK]] 2023-02-11 22:03:45,195 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:45,196 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:45,196 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:45,196 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:45,197 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:45,198 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 22:03:45,198 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 22:03:45,199 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:45,199 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:45,199 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:45,201 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:45,203 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:45,203 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59873858, jitterRate=-0.10780999064445496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:45,203 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676153025196Initializing all the Stores at 1676153025196Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153025196Cleaning up temporary data from old regions at 1676153025200 (+4 ms)Cleaning up detritus from prior splits at 1676153025200Region opened successfully at 1676153025203 (+3 ms) 2023-02-11 22:03:45,203 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 22:03:45,205 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 22:03:45,205 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 22:03:45,205 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 22:03:45,205 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 22:03:45,205 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 22:03:45,205 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 22:03:45,206 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 22:03:45,207 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 22:03:45,217 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 22:03:45,217 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 22:03:45,217 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 22:03:45,217 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 22:03:45,218 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 22:03:45,221 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:45,221 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 22:03:45,221 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 22:03:45,222 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 22:03:45,223 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:45,223 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:45,223 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:45,223 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:45,223 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,41571,1676153025022, sessionid=0x100456a51da0000, setting cluster-up flag (Was=false) 2023-02-11 22:03:45,228 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:45,232 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 22:03:45,233 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,41571,1676153025022 2023-02-11 22:03:45,236 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:45,239 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 22:03:45,239 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,41571,1676153025022 2023-02-11 22:03:45,240 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.hbase-snapshot/.tmp 2023-02-11 22:03:45,241 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:45,241 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:45,242 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:45,242 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:45,242 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:45,242 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-11 22:03:45,242 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,242 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:45,242 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,244 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676153055244 2023-02-11 22:03:45,244 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 22:03:45,244 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 22:03:45,244 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 22:03:45,244 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 22:03:45,244 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 22:03:45,244 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 22:03:45,244 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,244 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:45,244 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 22:03:45,244 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 22:03:45,245 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 22:03:45,245 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 22:03:45,245 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 22:03:45,245 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 22:03:45,245 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153025245,5,FailOnTimeoutGroup] 2023-02-11 22:03:45,245 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153025245,5,FailOnTimeoutGroup] 2023-02-11 22:03:45,246 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,246 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 22:03:45,246 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,246 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,246 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:45,259 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:45,259 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:45,260 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf 2023-02-11 22:03:45,269 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:45,271 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:45,272 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/info 2023-02-11 22:03:45,272 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:45,273 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:45,273 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:45,274 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:45,274 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:45,274 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:45,274 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:45,275 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/table 2023-02-11 22:03:45,275 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:45,276 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:45,276 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740 2023-02-11 22:03:45,277 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740 2023-02-11 22:03:45,278 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:45,279 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:45,280 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:45,281 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71084348, jitterRate=0.059239327907562256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:45,281 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676153025269Initializing all the Stores at 1676153025269Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153025269Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153025271 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153025271Cleaning up temporary data from old regions at 1676153025277 (+6 ms)Cleaning up detritus from prior splits at 1676153025278 (+1 ms)Region opened successfully at 1676153025281 (+3 ms) 2023-02-11 22:03:45,281 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:45,281 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:45,281 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:45,281 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:45,281 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:45,281 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:45,281 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153025281Disabling compacts and flushes for region at 1676153025281Disabling writes for close at 1676153025281Writing region close event to WAL at 1676153025281Closed at 1676153025281 2023-02-11 22:03:45,282 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:45,282 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 22:03:45,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 22:03:45,284 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 22:03:45,285 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 22:03:45,321 INFO [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(952): ClusterId : f3e01893-3cb4-478d-bb19-1937d0fa31eb 2023-02-11 22:03:45,321 INFO [RS:1;jenkins-hbase9:44297] regionserver.HRegionServer(952): ClusterId : f3e01893-3cb4-478d-bb19-1937d0fa31eb 2023-02-11 22:03:45,321 DEBUG [RS:0;jenkins-hbase9:37599] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:45,321 DEBUG [RS:1;jenkins-hbase9:44297] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:45,323 DEBUG [RS:1;jenkins-hbase9:44297] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:45,323 DEBUG [RS:1;jenkins-hbase9:44297] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:45,323 DEBUG [RS:0;jenkins-hbase9:37599] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:45,324 DEBUG [RS:0;jenkins-hbase9:37599] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:45,325 DEBUG [RS:1;jenkins-hbase9:44297] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:45,328 DEBUG [RS:1;jenkins-hbase9:44297] zookeeper.ReadOnlyZKClient(139): Connect 0x303702e3 to 127.0.0.1:53693 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:45,328 DEBUG [RS:0;jenkins-hbase9:37599] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:45,329 DEBUG [RS:0;jenkins-hbase9:37599] zookeeper.ReadOnlyZKClient(139): Connect 0x4ef58fea to 127.0.0.1:53693 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:45,341 DEBUG [RS:1;jenkins-hbase9:44297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ef0ea95, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:45,341 DEBUG [RS:0;jenkins-hbase9:37599] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40327844, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:45,341 DEBUG [RS:1;jenkins-hbase9:44297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3acf6993, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:45,341 DEBUG [RS:0;jenkins-hbase9:37599] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@440de49a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:45,349 DEBUG [RS:1;jenkins-hbase9:44297] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:44297 2023-02-11 22:03:45,350 DEBUG [RS:0;jenkins-hbase9:37599] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:37599 2023-02-11 22:03:45,350 INFO [RS:1;jenkins-hbase9:44297] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:45,350 INFO [RS:0;jenkins-hbase9:37599] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:45,350 INFO [RS:0;jenkins-hbase9:37599] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:45,350 INFO [RS:1;jenkins-hbase9:44297] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:45,350 DEBUG [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:45,350 DEBUG [RS:1;jenkins-hbase9:44297] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:45,350 INFO [RS:1;jenkins-hbase9:44297] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,41571,1676153025022 with isa=jenkins-hbase9.apache.org/172.31.2.10:44297, startcode=1676153025101 2023-02-11 22:03:45,350 INFO [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,41571,1676153025022 with isa=jenkins-hbase9.apache.org/172.31.2.10:37599, startcode=1676153025072 2023-02-11 22:03:45,351 DEBUG [RS:1;jenkins-hbase9:44297] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:45,351 DEBUG [RS:0;jenkins-hbase9:37599] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:45,352 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39325, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:45,352 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59449, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:45,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41571] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:45,354 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:45,355 DEBUG [RS:1;jenkins-hbase9:44297] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf 2023-02-11 22:03:45,355 DEBUG [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf 2023-02-11 22:03:45,355 DEBUG [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41845 2023-02-11 22:03:45,355 DEBUG [RS:1;jenkins-hbase9:44297] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41845 2023-02-11 22:03:45,355 DEBUG [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:45,355 DEBUG [RS:1;jenkins-hbase9:44297] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:45,359 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:45,359 DEBUG [RS:0;jenkins-hbase9:37599] zookeeper.ZKUtil(162): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:45,359 DEBUG [RS:1;jenkins-hbase9:44297] zookeeper.ZKUtil(162): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:45,360 WARN [RS:0;jenkins-hbase9:37599] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:45,360 WARN [RS:1;jenkins-hbase9:44297] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:45,360 INFO [RS:0;jenkins-hbase9:37599] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:45,360 INFO [RS:1;jenkins-hbase9:44297] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:45,360 DEBUG [RS:1;jenkins-hbase9:44297] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/WALs/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:45,360 DEBUG [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/WALs/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:45,360 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,37599,1676153025072] 2023-02-11 22:03:45,360 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,44297,1676153025101] 2023-02-11 22:03:45,366 DEBUG [RS:1;jenkins-hbase9:44297] zookeeper.ZKUtil(162): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:45,366 DEBUG [RS:0;jenkins-hbase9:37599] zookeeper.ZKUtil(162): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:45,367 DEBUG [RS:1;jenkins-hbase9:44297] zookeeper.ZKUtil(162): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:45,367 DEBUG [RS:0;jenkins-hbase9:37599] zookeeper.ZKUtil(162): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:45,367 DEBUG [RS:1;jenkins-hbase9:44297] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:45,367 DEBUG [RS:0;jenkins-hbase9:37599] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:45,368 INFO [RS:1;jenkins-hbase9:44297] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:45,368 INFO [RS:0;jenkins-hbase9:37599] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:45,369 INFO [RS:1;jenkins-hbase9:44297] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:45,369 INFO [RS:1;jenkins-hbase9:44297] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:45,370 INFO [RS:1;jenkins-hbase9:44297] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,370 INFO [RS:0;jenkins-hbase9:37599] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:45,370 INFO [RS:1;jenkins-hbase9:44297] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:45,371 INFO [RS:0;jenkins-hbase9:37599] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:45,371 INFO [RS:0;jenkins-hbase9:37599] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,371 INFO [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:45,372 INFO [RS:1;jenkins-hbase9:44297] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,372 DEBUG [RS:1;jenkins-hbase9:44297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,373 DEBUG [RS:1;jenkins-hbase9:44297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,373 DEBUG [RS:1;jenkins-hbase9:44297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,373 DEBUG [RS:1;jenkins-hbase9:44297] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,373 DEBUG [RS:1;jenkins-hbase9:44297] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,373 INFO [RS:0;jenkins-hbase9:37599] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,373 DEBUG [RS:1;jenkins-hbase9:44297] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:45,373 DEBUG [RS:1;jenkins-hbase9:44297] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,373 DEBUG [RS:0;jenkins-hbase9:37599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,374 DEBUG [RS:1;jenkins-hbase9:44297] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,374 DEBUG [RS:0;jenkins-hbase9:37599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,374 DEBUG [RS:1;jenkins-hbase9:44297] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,374 DEBUG [RS:0;jenkins-hbase9:37599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,374 DEBUG [RS:1;jenkins-hbase9:44297] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,374 DEBUG [RS:0;jenkins-hbase9:37599] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,374 DEBUG [RS:0;jenkins-hbase9:37599] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,374 DEBUG [RS:0;jenkins-hbase9:37599] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:45,374 DEBUG [RS:0;jenkins-hbase9:37599] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,374 DEBUG [RS:0;jenkins-hbase9:37599] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,374 DEBUG [RS:0;jenkins-hbase9:37599] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,374 DEBUG [RS:0;jenkins-hbase9:37599] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:45,378 INFO [RS:1;jenkins-hbase9:44297] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,378 INFO [RS:1;jenkins-hbase9:44297] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,378 INFO [RS:1;jenkins-hbase9:44297] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,378 INFO [RS:0;jenkins-hbase9:37599] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,378 INFO [RS:0;jenkins-hbase9:37599] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,379 INFO [RS:0;jenkins-hbase9:37599] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,390 INFO [RS:0;jenkins-hbase9:37599] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:45,390 INFO [RS:0;jenkins-hbase9:37599] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37599,1676153025072-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,395 INFO [RS:1;jenkins-hbase9:44297] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:45,395 INFO [RS:1;jenkins-hbase9:44297] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44297,1676153025101-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,401 INFO [RS:0;jenkins-hbase9:37599] regionserver.Replication(203): jenkins-hbase9.apache.org,37599,1676153025072 started 2023-02-11 22:03:45,401 INFO [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,37599,1676153025072, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:37599, sessionid=0x100456a51da0001 2023-02-11 22:03:45,401 DEBUG [RS:0;jenkins-hbase9:37599] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:45,401 DEBUG [RS:0;jenkins-hbase9:37599] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:45,401 DEBUG [RS:0;jenkins-hbase9:37599] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37599,1676153025072' 2023-02-11 22:03:45,401 DEBUG [RS:0;jenkins-hbase9:37599] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:45,401 DEBUG [RS:0;jenkins-hbase9:37599] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:45,402 DEBUG [RS:0;jenkins-hbase9:37599] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:45,402 DEBUG [RS:0;jenkins-hbase9:37599] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:45,402 DEBUG [RS:0;jenkins-hbase9:37599] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:45,402 DEBUG [RS:0;jenkins-hbase9:37599] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37599,1676153025072' 2023-02-11 22:03:45,402 DEBUG [RS:0;jenkins-hbase9:37599] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:45,402 DEBUG [RS:0;jenkins-hbase9:37599] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:45,402 DEBUG [RS:0;jenkins-hbase9:37599] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:45,402 INFO [RS:0;jenkins-hbase9:37599] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:45,402 INFO [RS:0;jenkins-hbase9:37599] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:45,412 INFO [RS:1;jenkins-hbase9:44297] regionserver.Replication(203): jenkins-hbase9.apache.org,44297,1676153025101 started 2023-02-11 22:03:45,412 INFO [RS:1;jenkins-hbase9:44297] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,44297,1676153025101, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:44297, sessionid=0x100456a51da0002 2023-02-11 22:03:45,412 DEBUG [RS:1;jenkins-hbase9:44297] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:45,412 DEBUG [RS:1;jenkins-hbase9:44297] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:45,412 DEBUG [RS:1;jenkins-hbase9:44297] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44297,1676153025101' 2023-02-11 22:03:45,412 DEBUG [RS:1;jenkins-hbase9:44297] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:45,413 DEBUG [RS:1;jenkins-hbase9:44297] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:45,413 DEBUG [RS:1;jenkins-hbase9:44297] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:45,413 DEBUG [RS:1;jenkins-hbase9:44297] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:45,413 DEBUG [RS:1;jenkins-hbase9:44297] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:45,413 DEBUG [RS:1;jenkins-hbase9:44297] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44297,1676153025101' 2023-02-11 22:03:45,413 DEBUG [RS:1;jenkins-hbase9:44297] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:45,414 DEBUG [RS:1;jenkins-hbase9:44297] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:45,414 DEBUG [RS:1;jenkins-hbase9:44297] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:45,414 INFO [RS:1;jenkins-hbase9:44297] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:45,414 INFO [RS:1;jenkins-hbase9:44297] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:45,435 DEBUG [jenkins-hbase9:41571] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 22:03:45,436 DEBUG [jenkins-hbase9:41571] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:45,437 DEBUG [jenkins-hbase9:41571] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:45,437 DEBUG [jenkins-hbase9:41571] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:45,437 DEBUG [jenkins-hbase9:41571] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:45,437 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,37599,1676153025072, state=OPENING 2023-02-11 22:03:45,438 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 22:03:45,439 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:45,442 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:45,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,37599,1676153025072}] 2023-02-11 22:03:45,596 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:45,596 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 22:03:45,598 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54170, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 22:03:45,602 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 22:03:45,602 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:45,603 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37599%2C1676153025072.meta, suffix=.meta, logDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/WALs/jenkins-hbase9.apache.org,37599,1676153025072, archiveDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/oldWALs, maxLogs=32 2023-02-11 22:03:45,616 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44175,DS-886e7a13-b92c-48c3-aa61-66c254acb427,DISK] 2023-02-11 22:03:45,616 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44783,DS-d9a89d10-6dc6-4638-b7e4-66aff080e7be,DISK] 2023-02-11 22:03:45,617 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/WALs/jenkins-hbase9.apache.org,37599,1676153025072/jenkins-hbase9.apache.org%2C37599%2C1676153025072.meta.1676153025603.meta 2023-02-11 22:03:45,617 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44175,DS-886e7a13-b92c-48c3-aa61-66c254acb427,DISK], DatanodeInfoWithStorage[127.0.0.1:44783,DS-d9a89d10-6dc6-4638-b7e4-66aff080e7be,DISK]] 2023-02-11 22:03:45,617 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:45,618 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 22:03:45,618 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 22:03:45,618 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 22:03:45,618 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 22:03:45,618 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:45,618 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 22:03:45,618 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 22:03:45,619 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:45,620 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/info 2023-02-11 22:03:45,620 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/info 2023-02-11 22:03:45,620 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:45,621 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:45,621 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:45,621 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:45,621 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:45,622 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:45,622 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:45,622 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:45,623 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/table 2023-02-11 22:03:45,623 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/table 2023-02-11 22:03:45,623 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:45,623 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:45,624 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740 2023-02-11 22:03:45,625 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740 2023-02-11 22:03:45,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:45,627 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:45,627 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71421470, jitterRate=0.06426283717155457}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:45,627 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676153025618Writing region info on filesystem at 1676153025618Initializing all the Stores at 1676153025619 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153025619Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153025619Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153025619Cleaning up temporary data from old regions at 1676153025625 (+6 ms)Cleaning up detritus from prior splits at 1676153025625Running coprocessor post-open hooks at 1676153025627 (+2 ms)Region opened successfully at 1676153025627 2023-02-11 22:03:45,628 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676153025596 2023-02-11 22:03:45,631 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 22:03:45,631 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 22:03:45,632 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,37599,1676153025072, state=OPEN 2023-02-11 22:03:45,634 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 22:03:45,634 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:45,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 22:03:45,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,37599,1676153025072 in 194 msec 2023-02-11 22:03:45,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 22:03:45,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-11 22:03:45,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 397 msec 2023-02-11 22:03:45,638 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676153025121, completionTime=-1 2023-02-11 22:03:45,638 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 22:03:45,638 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 22:03:45,640 DEBUG [hconnection-0x2d7f706f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:45,642 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54176, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:45,643 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 22:03:45,643 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676153085643 2023-02-11 22:03:45,643 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676153145643 2023-02-11 22:03:45,643 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-11 22:03:45,648 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41571,1676153025022-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,649 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41571,1676153025022-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,649 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41571,1676153025022-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,649 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:41571, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,649 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:45,649 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 22:03:45,649 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:45,650 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 22:03:45,651 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 22:03:45,651 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:45,651 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:45,653 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20 2023-02-11 22:03:45,653 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20 empty. 2023-02-11 22:03:45,653 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20 2023-02-11 22:03:45,653 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 22:03:45,661 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:45,662 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 80fc27bf8096829cf38e6dfe8f371b20, NAME => 'hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp 2023-02-11 22:03:45,668 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:45,669 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 80fc27bf8096829cf38e6dfe8f371b20, disabling compactions & flushes 2023-02-11 22:03:45,669 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. 2023-02-11 22:03:45,669 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. 2023-02-11 22:03:45,669 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. after waiting 0 ms 2023-02-11 22:03:45,669 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. 2023-02-11 22:03:45,669 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. 2023-02-11 22:03:45,669 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 80fc27bf8096829cf38e6dfe8f371b20: Waiting for close lock at 1676153025669Disabling compacts and flushes for region at 1676153025669Disabling writes for close at 1676153025669Writing region close event to WAL at 1676153025669Closed at 1676153025669 2023-02-11 22:03:45,670 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:45,671 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153025671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153025671"}]},"ts":"1676153025671"} 2023-02-11 22:03:45,673 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 22:03:45,674 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:45,674 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153025674"}]},"ts":"1676153025674"} 2023-02-11 22:03:45,675 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 22:03:45,678 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:45,679 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:45,679 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:45,679 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:45,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=80fc27bf8096829cf38e6dfe8f371b20, ASSIGN}] 2023-02-11 22:03:45,681 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=80fc27bf8096829cf38e6dfe8f371b20, ASSIGN 2023-02-11 22:03:45,681 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=80fc27bf8096829cf38e6dfe8f371b20, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,37599,1676153025072; forceNewPlan=false, retain=false 2023-02-11 22:03:45,832 INFO [jenkins-hbase9:41571] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 22:03:45,832 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=80fc27bf8096829cf38e6dfe8f371b20, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:45,832 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153025832"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153025832"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153025832"}]},"ts":"1676153025832"} 2023-02-11 22:03:45,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 80fc27bf8096829cf38e6dfe8f371b20, server=jenkins-hbase9.apache.org,37599,1676153025072}] 2023-02-11 22:03:45,988 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. 2023-02-11 22:03:45,989 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37599%2C1676153025072, suffix=, logDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/WALs/jenkins-hbase9.apache.org,37599,1676153025072, archiveDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/oldWALs, maxLogs=32 2023-02-11 22:03:46,001 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44783,DS-d9a89d10-6dc6-4638-b7e4-66aff080e7be,DISK] 2023-02-11 22:03:46,001 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44175,DS-886e7a13-b92c-48c3-aa61-66c254acb427,DISK] 2023-02-11 22:03:46,003 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/WALs/jenkins-hbase9.apache.org,37599,1676153025072/jenkins-hbase9.apache.org%2C37599%2C1676153025072.1676153025990 2023-02-11 22:03:46,003 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44783,DS-d9a89d10-6dc6-4638-b7e4-66aff080e7be,DISK], DatanodeInfoWithStorage[127.0.0.1:44175,DS-886e7a13-b92c-48c3-aa61-66c254acb427,DISK]] 2023-02-11 22:03:46,003 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 80fc27bf8096829cf38e6dfe8f371b20, NAME => 'hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:46,004 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 80fc27bf8096829cf38e6dfe8f371b20 2023-02-11 22:03:46,004 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:46,004 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 80fc27bf8096829cf38e6dfe8f371b20 2023-02-11 22:03:46,004 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 80fc27bf8096829cf38e6dfe8f371b20 2023-02-11 22:03:46,005 INFO [StoreOpener-80fc27bf8096829cf38e6dfe8f371b20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 80fc27bf8096829cf38e6dfe8f371b20 2023-02-11 22:03:46,006 DEBUG [StoreOpener-80fc27bf8096829cf38e6dfe8f371b20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20/info 2023-02-11 22:03:46,006 DEBUG [StoreOpener-80fc27bf8096829cf38e6dfe8f371b20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20/info 2023-02-11 22:03:46,006 INFO [StoreOpener-80fc27bf8096829cf38e6dfe8f371b20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80fc27bf8096829cf38e6dfe8f371b20 columnFamilyName info 2023-02-11 22:03:46,007 INFO [StoreOpener-80fc27bf8096829cf38e6dfe8f371b20-1] regionserver.HStore(310): Store=80fc27bf8096829cf38e6dfe8f371b20/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:46,007 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20 2023-02-11 22:03:46,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20 2023-02-11 22:03:46,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 80fc27bf8096829cf38e6dfe8f371b20 2023-02-11 22:03:46,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:46,012 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 80fc27bf8096829cf38e6dfe8f371b20; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74628860, jitterRate=0.1120566725730896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:46,012 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 80fc27bf8096829cf38e6dfe8f371b20: Running coprocessor pre-open hook at 1676153026004Writing region info on filesystem at 1676153026004Initializing all the Stores at 1676153026004Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153026005 (+1 ms)Cleaning up temporary data from old regions at 1676153026008 (+3 ms)Cleaning up detritus from prior splits at 1676153026008Running coprocessor post-open hooks at 1676153026012 (+4 ms)Region opened successfully at 1676153026012 2023-02-11 22:03:46,012 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20., pid=6, masterSystemTime=1676153025985 2023-02-11 22:03:46,014 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. 2023-02-11 22:03:46,015 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. 2023-02-11 22:03:46,015 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=80fc27bf8096829cf38e6dfe8f371b20, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,015 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153026015"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153026015"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153026015"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153026015"}]},"ts":"1676153026015"} 2023-02-11 22:03:46,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 22:03:46,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 80fc27bf8096829cf38e6dfe8f371b20, server=jenkins-hbase9.apache.org,37599,1676153025072 in 182 msec 2023-02-11 22:03:46,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 22:03:46,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=80fc27bf8096829cf38e6dfe8f371b20, ASSIGN in 338 msec 2023-02-11 22:03:46,019 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:46,019 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153026019"}]},"ts":"1676153026019"} 2023-02-11 22:03:46,020 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 22:03:46,022 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:46,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 373 msec 2023-02-11 22:03:46,050 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 22:03:46,052 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:46,052 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:46,055 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 22:03:46,061 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:46,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-11 22:03:46,066 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 22:03:46,071 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:46,073 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-11 22:03:46,080 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 22:03:46,082 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 22:03:46,082 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.954sec 2023-02-11 22:03:46,082 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 22:03:46,082 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 22:03:46,082 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 22:03:46,082 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41571,1676153025022-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 22:03:46,082 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41571,1676153025022-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 22:03:46,084 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 22:03:46,121 DEBUG [Listener at localhost/45513] zookeeper.ReadOnlyZKClient(139): Connect 0x7d6cbb43 to 127.0.0.1:53693 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:46,130 DEBUG [Listener at localhost/45513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@783368b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:46,131 DEBUG [hconnection-0x7601e20-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:46,133 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54186, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:46,134 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,41571,1676153025022 2023-02-11 22:03:46,134 DEBUG [Listener at localhost/45513] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 22:03:46,135 DEBUG [Listener at localhost/45513] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 22:03:46,137 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38088, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 22:03:46,137 INFO [Listener at localhost/45513] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,137 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 22:03:46,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.2.10:38088 deadline: 1676153086137, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,138 INFO [Listener at localhost/45513] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-11 22:03:46,140 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:46,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,142 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:46,142 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-11 22:03:46,142 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:46,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:46,144 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:46,144 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880 empty. 2023-02-11 22:03:46,144 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:46,144 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-11 22:03:46,152 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:46,153 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => fdff4182ad4e0fc1f2a96d21b5fb0880, NAME => 'testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp 2023-02-11 22:03:46,159 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:46,159 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing fdff4182ad4e0fc1f2a96d21b5fb0880, disabling compactions & flushes 2023-02-11 22:03:46,159 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:46,159 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:46,159 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. after waiting 0 ms 2023-02-11 22:03:46,159 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:46,159 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:46,159 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for fdff4182ad4e0fc1f2a96d21b5fb0880: Waiting for close lock at 1676153026159Disabling compacts and flushes for region at 1676153026159Disabling writes for close at 1676153026159Writing region close event to WAL at 1676153026159Closed at 1676153026159 2023-02-11 22:03:46,161 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:46,162 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676153026162"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153026162"}]},"ts":"1676153026162"} 2023-02-11 22:03:46,163 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 22:03:46,164 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:46,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153026164"}]},"ts":"1676153026164"} 2023-02-11 22:03:46,165 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-11 22:03:46,168 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:46,169 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:46,169 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:46,169 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:46,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=fdff4182ad4e0fc1f2a96d21b5fb0880, ASSIGN}] 2023-02-11 22:03:46,171 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=fdff4182ad4e0fc1f2a96d21b5fb0880, ASSIGN 2023-02-11 22:03:46,172 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=fdff4182ad4e0fc1f2a96d21b5fb0880, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,37599,1676153025072; forceNewPlan=false, retain=false 2023-02-11 22:03:46,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:46,322 INFO [jenkins-hbase9:41571] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 22:03:46,322 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fdff4182ad4e0fc1f2a96d21b5fb0880, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,322 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676153026322"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153026322"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153026322"}]},"ts":"1676153026322"} 2023-02-11 22:03:46,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure fdff4182ad4e0fc1f2a96d21b5fb0880, server=jenkins-hbase9.apache.org,37599,1676153025072}] 2023-02-11 22:03:46,415 INFO [RS:1;jenkins-hbase9:44297] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C44297%2C1676153025101, suffix=, logDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/WALs/jenkins-hbase9.apache.org,44297,1676153025101, archiveDir=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/oldWALs, maxLogs=32 2023-02-11 22:03:46,430 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44175,DS-886e7a13-b92c-48c3-aa61-66c254acb427,DISK] 2023-02-11 22:03:46,430 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44783,DS-d9a89d10-6dc6-4638-b7e4-66aff080e7be,DISK] 2023-02-11 22:03:46,431 INFO [RS:1;jenkins-hbase9:44297] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/WALs/jenkins-hbase9.apache.org,44297,1676153025101/jenkins-hbase9.apache.org%2C44297%2C1676153025101.1676153026416 2023-02-11 22:03:46,431 DEBUG [RS:1;jenkins-hbase9:44297] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44175,DS-886e7a13-b92c-48c3-aa61-66c254acb427,DISK], DatanodeInfoWithStorage[127.0.0.1:44783,DS-d9a89d10-6dc6-4638-b7e4-66aff080e7be,DISK]] 2023-02-11 22:03:46,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:46,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:46,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fdff4182ad4e0fc1f2a96d21b5fb0880, NAME => 'testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:46,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:46,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:46,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:46,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:46,479 INFO [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:46,480 DEBUG [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1 2023-02-11 22:03:46,480 DEBUG [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1 2023-02-11 22:03:46,481 INFO [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdff4182ad4e0fc1f2a96d21b5fb0880 columnFamilyName f1 2023-02-11 22:03:46,481 INFO [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] regionserver.HStore(310): Store=fdff4182ad4e0fc1f2a96d21b5fb0880/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:46,481 INFO [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:46,482 DEBUG [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2 2023-02-11 22:03:46,482 DEBUG [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2 2023-02-11 22:03:46,482 INFO [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdff4182ad4e0fc1f2a96d21b5fb0880 columnFamilyName f2 2023-02-11 22:03:46,483 INFO [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] regionserver.HStore(310): Store=fdff4182ad4e0fc1f2a96d21b5fb0880/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:46,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:46,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:46,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:46,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:46,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:46,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened fdff4182ad4e0fc1f2a96d21b5fb0880; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64936795, jitterRate=-0.032366350293159485}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:46,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for fdff4182ad4e0fc1f2a96d21b5fb0880: Running coprocessor pre-open hook at 1676153026478Writing region info on filesystem at 1676153026478Initializing all the Stores at 1676153026479 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153026479Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153026479Cleaning up temporary data from old regions at 1676153026484 (+5 ms)Cleaning up detritus from prior splits at 1676153026484Running coprocessor post-open hooks at 1676153026487 (+3 ms)Region opened successfully at 1676153026487 2023-02-11 22:03:46,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880., pid=12, masterSystemTime=1676153026475 2023-02-11 22:03:46,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:46,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:46,489 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fdff4182ad4e0fc1f2a96d21b5fb0880, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,490 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676153026489"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153026489"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153026489"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153026489"}]},"ts":"1676153026489"} 2023-02-11 22:03:46,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-11 22:03:46,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure fdff4182ad4e0fc1f2a96d21b5fb0880, server=jenkins-hbase9.apache.org,37599,1676153025072 in 167 msec 2023-02-11 22:03:46,493 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 22:03:46,493 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=fdff4182ad4e0fc1f2a96d21b5fb0880, ASSIGN in 323 msec 2023-02-11 22:03:46,494 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:46,494 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153026494"}]},"ts":"1676153026494"} 2023-02-11 22:03:46,495 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-11 22:03:46,497 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:46,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 357 msec 2023-02-11 22:03:46,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:46,747 INFO [Listener at localhost/45513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-11 22:03:46,747 DEBUG [Listener at localhost/45513] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-11 22:03:46,747 INFO [Listener at localhost/45513] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:46,749 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-11 22:03:46,749 INFO [Listener at localhost/45513] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:46,749 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-11 22:03:46,749 INFO [Listener at localhost/45513] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 22:03:46,792 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37599] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:46,874 INFO [Listener at localhost/45513] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 22:03:46,874 INFO [Listener at localhost/45513] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 22:03:46,875 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-11 22:03:46,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676153026875 (current time:1676153026875). 2023-02-11 22:03:46,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 22:03:46,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] zookeeper.ReadOnlyZKClient(139): Connect 0x3ce494cf to 127.0.0.1:53693 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:46,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ad122c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:46,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:46,881 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54200, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:46,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ce494cf to 127.0.0.1:53693 2023-02-11 22:03:46,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:46,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 22:03:46,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-11 22:03:46,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-11 22:03:46,885 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-11 22:03:46,886 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676153626886 2023-02-11 22:03:46,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-11 22:03:46,886 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,887 DEBUG [Listener at localhost/45513] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:46,887 DEBUG [Listener at localhost/45513] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 22:03:46,888 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-11 22:03:46,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-11 22:03:46,889 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-11 22:03:46,889 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-11 22:03:46,890 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676153626890 2023-02-11 22:03:46,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,896 INFO [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-11 22:03:46,897 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:46,897 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-11 22:03:46,897 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-11 22:03:46,897 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,898 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,898 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:46,898 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:46,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:46,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:46,898 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:46,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:46,899 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,899 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:46,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-11 22:03:46,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-11 22:03:46,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-11 22:03:46,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-11 22:03:46,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,900 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-11 22:03:46,900 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:46,900 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-11 22:03:46,901 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 22:03:46,901 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-11 22:03:46,901 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:46,901 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44297,1676153025101' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-11 22:03:46,901 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 22:03:46,901 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-11 22:03:46,901 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37599,1676153025072' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-11 22:03:46,903 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,903 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:46,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:46,903 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,903 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:46,904 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:46,904 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,904 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:46,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:46,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:46,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:46,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,37599,1676153025072' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-11 22:03:46,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25f3f856[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:46,905 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-11 22:03:46,905 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,907 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,907 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,907 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 22:03:46,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,907 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-11 22:03:46,907 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,907 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:46,907 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 22:03:46,907 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. started... 2023-02-11 22:03:46,907 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:46,907 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 22:03:46,908 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-11 22:03:46,908 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,44297,1676153025101' in zk 2023-02-11 22:03:46,908 INFO [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] regionserver.HRegion(2744): Flushing fdff4182ad4e0fc1f2a96d21b5fb0880 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-11 22:03:46,909 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-11 22:03:46,909 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:46,909 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-11 22:03:46,927 INFO [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/.tmp/f1/8795524139ee4a64a90be7424aeae5ff 2023-02-11 22:03:46,942 INFO [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/.tmp/f2/0cb870885de6420b8f0cb380ff580956 2023-02-11 22:03:46,946 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/.tmp/f1/8795524139ee4a64a90be7424aeae5ff as hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1/8795524139ee4a64a90be7424aeae5ff 2023-02-11 22:03:46,950 INFO [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1/8795524139ee4a64a90be7424aeae5ff, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 22:03:46,950 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/.tmp/f2/0cb870885de6420b8f0cb380ff580956 as hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2/0cb870885de6420b8f0cb380ff580956 2023-02-11 22:03:46,954 INFO [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2/0cb870885de6420b8f0cb380ff580956, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 22:03:46,954 INFO [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for fdff4182ad4e0fc1f2a96d21b5fb0880 in 46ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:46,954 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-11 22:03:46,955 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fdff4182ad4e0fc1f2a96d21b5fb0880: 2023-02-11 22:03:46,955 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,955 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:46,955 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1/8795524139ee4a64a90be7424aeae5ff] hfiles 2023-02-11 22:03:46,955 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1/8795524139ee4a64a90be7424aeae5ff for snapshot=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,955 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2/0cb870885de6420b8f0cb380ff580956] hfiles 2023-02-11 22:03:46,955 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2/0cb870885de6420b8f0cb380ff580956 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,960 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. completed. 2023-02-11 22:03:46,960 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:46,960 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-11 22:03:46,960 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-11 22:03:46,960 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,960 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-11 22:03:46,960 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,37599,1676153025072' in zk 2023-02-11 22:03:46,968 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-11 22:03:46,968 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,968 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:46,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,968 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-11 22:03:46,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:46,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:46,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:46,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:46,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:46,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:46,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:46,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase9.apache.org,37599,1676153025072': 2023-02-11 22:03:46,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,37599,1676153025072' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-11 22:03:46,970 INFO [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-11 22:03:46,970 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:46,970 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:46,970 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,971 INFO [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 22:03:46,972 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,972 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,972 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:46,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,972 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:46,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:46,972 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:46,972 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:46,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:46,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:46,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:46,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:46,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:46,973 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:46,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:46,974 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:46,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,974 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:46,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:46,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,984 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,984 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,984 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:46,984 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:46,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:46,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion because node does not exist (not an error) 2023-02-11 22:03:46,984 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:46,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,985 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:46,984 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:46,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:46,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:46,985 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:46,985 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,985 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:46,985 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,985 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:46,986 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,986 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:46,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:46,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:46,987 DEBUG [Listener at localhost/45513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:46,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-11 22:03:46,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:46,988 DEBUG [Listener at localhost/45513] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 22:03:46,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-11 22:03:47,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,013 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676153026886Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676153026985 (+99 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676153026985Writing data manifest for testWithMockedMapReduceSingleRegion at 1676153026988 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676153026994 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676153027012 (+18 ms) 2023-02-11 22:03:47,015 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-11 22:03:47,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 128 msec 2023-02-11 22:03:47,189 DEBUG [Listener at localhost/45513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:47,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-11 22:03:47,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 22:03:47,190 INFO [Listener at localhost/45513] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 22:03:47,194 INFO [Listener at localhost/45513] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 22:03:47,198 INFO [Listener at localhost/45513] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 22:03:47,225 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37599] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,305 INFO [Listener at localhost/45513] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 22:03:47,310 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-11 22:03:47,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,311 INFO [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-11 22:03:47,312 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:47,312 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-11 22:03:47,312 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-11 22:03:47,313 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,313 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,314 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:47,314 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:47,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:47,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:47,314 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:47,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:47,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,314 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,314 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:47,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:47,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:47,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,315 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-11 22:03:47,315 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:47,316 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-11 22:03:47,316 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:47,316 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 22:03:47,316 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-11 22:03:47,317 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44297,1676153025101' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-11 22:03:47,317 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 22:03:47,317 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 22:03:47,317 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 22:03:47,317 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,317 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. started... 2023-02-11 22:03:47,317 INFO [rs(jenkins-hbase9.apache.org,37599,1676153025072)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fdff4182ad4e0fc1f2a96d21b5fb0880 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-11 22:03:47,319 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,319 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,319 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:47,332 INFO [rs(jenkins-hbase9.apache.org,37599,1676153025072)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/.tmp/f1/0bcdcb7d61d64482b12597bcf6715a4d 2023-02-11 22:03:47,350 INFO [rs(jenkins-hbase9.apache.org,37599,1676153025072)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/.tmp/f2/045511c86e6a45a890c5fce97dde20da 2023-02-11 22:03:47,354 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/.tmp/f1/0bcdcb7d61d64482b12597bcf6715a4d as hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1/0bcdcb7d61d64482b12597bcf6715a4d 2023-02-11 22:03:47,358 INFO [rs(jenkins-hbase9.apache.org,37599,1676153025072)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1/0bcdcb7d61d64482b12597bcf6715a4d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 22:03:47,359 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/.tmp/f2/045511c86e6a45a890c5fce97dde20da as hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2/045511c86e6a45a890c5fce97dde20da 2023-02-11 22:03:47,365 INFO [rs(jenkins-hbase9.apache.org,37599,1676153025072)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2/045511c86e6a45a890c5fce97dde20da, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 22:03:47,366 INFO [rs(jenkins-hbase9.apache.org,37599,1676153025072)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for fdff4182ad4e0fc1f2a96d21b5fb0880 in 49ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:47,367 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fdff4182ad4e0fc1f2a96d21b5fb0880: 2023-02-11 22:03:47,367 DEBUG [rs(jenkins-hbase9.apache.org,37599,1676153025072)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,367 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 22:03:47,367 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 22:03:47,367 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,367 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-11 22:03:47,367 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37599,1676153025072' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-11 22:03:47,375 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,375 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:47,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:47,375 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,375 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:47,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:47,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:47,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:47,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:47,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,37599,1676153025072' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-11 22:03:47,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21cc6830[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:47,377 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-11 22:03:47,377 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,378 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,378 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,379 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 22:03:47,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,379 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,379 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 22:03:47,379 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-11 22:03:47,379 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:47,379 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-11 22:03:47,379 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,37599,1676153025072' in zk 2023-02-11 22:03:47,379 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,44297,1676153025101' in zk 2023-02-11 22:03:47,380 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-11 22:03:47,380 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-11 22:03:47,380 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:47,380 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:47,380 DEBUG [member: 'jenkins-hbase9.apache.org,37599,1676153025072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-11 22:03:47,380 DEBUG [member: 'jenkins-hbase9.apache.org,44297,1676153025101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-11 22:03:47,380 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:47,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:47,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:47,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:47,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:47,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:47,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:47,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase9.apache.org,37599,1676153025072': 2023-02-11 22:03:47,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,37599,1676153025072' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-11 22:03:47,383 INFO [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-11 22:03:47,383 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:47,383 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:47,383 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,383 INFO [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 22:03:47,384 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,384 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,384 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,384 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:47,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:47,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:47,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,384 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:47,385 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:47,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:47,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:47,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:47,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:47,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:47,385 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:47,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:47,386 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:47,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,387 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:47,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:47,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,390 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:47,390 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:47,390 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:47,390 DEBUG [(jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:47,390 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:47,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:47,390 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-11 22:03:47,390 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 22:03:47,390 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:47,390 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:47,390 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:47,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:47,390 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:47,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:47,390 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,390 DEBUG [Listener at localhost/45513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:47,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:47,390 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:47,391 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:47,390 DEBUG [Listener at localhost/45513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 22:03:47,391 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,391 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,491 DEBUG [Listener at localhost/45513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 22:03:47,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 22:03:47,496 INFO [Listener at localhost/45513] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676153026875 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:47,496 DEBUG [Listener at localhost/45513] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41845/user/jenkins/test-data/ea24cc2f-8b4c-fee8-164f-8498ec114b9b/testWithMockedMapReduceSingleRegion/973ca6d1-679b-43c9-aaf4-458ed9cfd829/data/default/testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,496 INFO [Listener at localhost/45513] snapshot.RestoreSnapshotHelper(239): region to add: fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:47,497 INFO [Listener at localhost/45513] snapshot.RestoreSnapshotHelper(585): clone region=fdff4182ad4e0fc1f2a96d21b5fb0880 as fdff4182ad4e0fc1f2a96d21b5fb0880 in snapshot testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,497 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => fdff4182ad4e0fc1f2a96d21b5fb0880, NAME => 'testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41845/user/jenkins/test-data/ea24cc2f-8b4c-fee8-164f-8498ec114b9b/testWithMockedMapReduceSingleRegion/973ca6d1-679b-43c9-aaf4-458ed9cfd829 2023-02-11 22:03:47,503 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:47,503 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8795524139ee4a64a90be7424aeae5ff from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,505 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0cb870885de6420b8f0cb380ff580956 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,506 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing fdff4182ad4e0fc1f2a96d21b5fb0880, disabling compactions & flushes 2023-02-11 22:03:47,506 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,506 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,506 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. after waiting 0 ms 2023-02-11 22:03:47,506 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,506 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,506 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for fdff4182ad4e0fc1f2a96d21b5fb0880: Waiting for close lock at 1676153027506Disabling compacts and flushes for region at 1676153027506Disabling writes for close at 1676153027506Writing region close event to WAL at 1676153027506Closed at 1676153027506 2023-02-11 22:03:47,506 INFO [Listener at localhost/45513] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676153026875 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:47,507 DEBUG [Listener at localhost/45513] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41845/user/jenkins/test-data/ea24cc2f-8b4c-fee8-164f-8498ec114b9b/testWithMockedMapReduceSingleRegion/973ca6d1-679b-43c9-aaf4-458ed9cfd829 2023-02-11 22:03:47,507 DEBUG [Listener at localhost/45513] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41845/user/jenkins/test-data/ea24cc2f-8b4c-fee8-164f-8498ec114b9b/testWithMockedMapReduceSingleRegion/973ca6d1-679b-43c9-aaf4-458ed9cfd829 2023-02-11 22:03:47,507 DEBUG [Listener at localhost/45513] util.CommonFSUtils(699): |-data/ 2023-02-11 22:03:47,507 DEBUG [Listener at localhost/45513] util.CommonFSUtils(699): |----default/ 2023-02-11 22:03:47,508 DEBUG [Listener at localhost/45513] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-11 22:03:47,508 DEBUG [Listener at localhost/45513] util.CommonFSUtils(699): |----------fdff4182ad4e0fc1f2a96d21b5fb0880/ 2023-02-11 22:03:47,508 DEBUG [Listener at localhost/45513] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:47,508 DEBUG [Listener at localhost/45513] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:47,508 DEBUG [Listener at localhost/45513] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=fdff4182ad4e0fc1f2a96d21b5fb0880-8795524139ee4a64a90be7424aeae5ff 2023-02-11 22:03:47,509 DEBUG [Listener at localhost/45513] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:47,509 DEBUG [Listener at localhost/45513] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=fdff4182ad4e0fc1f2a96d21b5fb0880-0cb870885de6420b8f0cb380ff580956 2023-02-11 22:03:47,511 INFO [Listener at localhost/45513] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 22:03:47,516 DEBUG [Listener at localhost/45513] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:47,516 INFO [Listener at localhost/45513] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:47,516 DEBUG [Listener at localhost/45513] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:47,518 INFO [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:47,519 DEBUG [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/ea24cc2f-8b4c-fee8-164f-8498ec114b9b/testWithMockedMapReduceSingleRegion/973ca6d1-679b-43c9-aaf4-458ed9cfd829/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1 2023-02-11 22:03:47,519 INFO [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdff4182ad4e0fc1f2a96d21b5fb0880 columnFamilyName f1 2023-02-11 22:03:47,523 DEBUG [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] regionserver.HStore(539): loaded hdfs://localhost:41845/user/jenkins/test-data/ea24cc2f-8b4c-fee8-164f-8498ec114b9b/testWithMockedMapReduceSingleRegion/973ca6d1-679b-43c9-aaf4-458ed9cfd829/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1/testWithMockedMapReduceSingleRegion=fdff4182ad4e0fc1f2a96d21b5fb0880-8795524139ee4a64a90be7424aeae5ff 2023-02-11 22:03:47,523 INFO [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] regionserver.HStore(310): Store=fdff4182ad4e0fc1f2a96d21b5fb0880/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:47,523 INFO [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:47,523 DEBUG [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41845/user/jenkins/test-data/ea24cc2f-8b4c-fee8-164f-8498ec114b9b/testWithMockedMapReduceSingleRegion/973ca6d1-679b-43c9-aaf4-458ed9cfd829/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2 2023-02-11 22:03:47,524 INFO [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdff4182ad4e0fc1f2a96d21b5fb0880 columnFamilyName f2 2023-02-11 22:03:47,527 DEBUG [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] regionserver.HStore(539): loaded hdfs://localhost:41845/user/jenkins/test-data/ea24cc2f-8b4c-fee8-164f-8498ec114b9b/testWithMockedMapReduceSingleRegion/973ca6d1-679b-43c9-aaf4-458ed9cfd829/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2/testWithMockedMapReduceSingleRegion=fdff4182ad4e0fc1f2a96d21b5fb0880-0cb870885de6420b8f0cb380ff580956 2023-02-11 22:03:47,527 INFO [StoreOpener-fdff4182ad4e0fc1f2a96d21b5fb0880-1] regionserver.HStore(310): Store=fdff4182ad4e0fc1f2a96d21b5fb0880/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:47,527 DEBUG [Listener at localhost/45513] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:47,527 INFO [Listener at localhost/45513] regionserver.HRegion(1071): Opened fdff4182ad4e0fc1f2a96d21b5fb0880; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75028433, jitterRate=0.11801077425479889}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:47,527 DEBUG [Listener at localhost/45513] regionserver.HRegion(964): Region open journal for fdff4182ad4e0fc1f2a96d21b5fb0880: Writing region info on filesystem at 1676153027516Initializing all the Stores at 1676153027517 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153027517Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153027517Region opened successfully at 1676153027527 (+10 ms) 2023-02-11 22:03:47,572 DEBUG [Listener at localhost/45513] regionserver.HRegion(1603): Closing fdff4182ad4e0fc1f2a96d21b5fb0880, disabling compactions & flushes 2023-02-11 22:03:47,572 INFO [Listener at localhost/45513] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,572 DEBUG [Listener at localhost/45513] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,572 DEBUG [Listener at localhost/45513] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. after waiting 0 ms 2023-02-11 22:03:47,572 DEBUG [Listener at localhost/45513] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,573 INFO [Listener at localhost/45513] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,573 DEBUG [Listener at localhost/45513] regionserver.HRegion(1557): Region close journal for fdff4182ad4e0fc1f2a96d21b5fb0880: Waiting for close lock at 1676153027572Disabling compacts and flushes for region at 1676153027572Disabling writes for close at 1676153027572Writing region close event to WAL at 1676153027573 (+1 ms)Closed at 1676153027573 2023-02-11 22:03:47,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-11 22:03:47,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,580 INFO [Listener at localhost/45513] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,580 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 22:03:47,584 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153027583"}]},"ts":"1676153027583"} 2023-02-11 22:03:47,585 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-11 22:03:47,586 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-11 22:03:47,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=fdff4182ad4e0fc1f2a96d21b5fb0880, UNASSIGN}] 2023-02-11 22:03:47,588 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=fdff4182ad4e0fc1f2a96d21b5fb0880, UNASSIGN 2023-02-11 22:03:47,588 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fdff4182ad4e0fc1f2a96d21b5fb0880, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,589 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676153027588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153027588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153027588"}]},"ts":"1676153027588"} 2023-02-11 22:03:47,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure fdff4182ad4e0fc1f2a96d21b5fb0880, server=jenkins-hbase9.apache.org,37599,1676153025072}] 2023-02-11 22:03:47,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 22:03:47,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:47,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing fdff4182ad4e0fc1f2a96d21b5fb0880, disabling compactions & flushes 2023-02-11 22:03:47,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. after waiting 0 ms 2023-02-11 22:03:47,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:47,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880. 2023-02-11 22:03:47,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for fdff4182ad4e0fc1f2a96d21b5fb0880: Waiting for close lock at 1676153027742Running coprocessor pre-close hooks at 1676153027742Disabling compacts and flushes for region at 1676153027742Disabling writes for close at 1676153027742Writing region close event to WAL at 1676153027743 (+1 ms)Running coprocessor post-close hooks at 1676153027746 (+3 ms)Closed at 1676153027746 2023-02-11 22:03:47,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:47,748 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fdff4182ad4e0fc1f2a96d21b5fb0880, regionState=CLOSED 2023-02-11 22:03:47,748 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676153027748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153027748"}]},"ts":"1676153027748"} 2023-02-11 22:03:47,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-11 22:03:47,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure fdff4182ad4e0fc1f2a96d21b5fb0880, server=jenkins-hbase9.apache.org,37599,1676153025072 in 162 msec 2023-02-11 22:03:47,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 22:03:47,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=fdff4182ad4e0fc1f2a96d21b5fb0880, UNASSIGN in 167 msec 2023-02-11 22:03:47,755 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153027755"}]},"ts":"1676153027755"} 2023-02-11 22:03:47,756 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-11 22:03:47,757 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-11 22:03:47,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 177 msec 2023-02-11 22:03:47,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 22:03:47,886 INFO [Listener at localhost/45513] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-11 22:03:47,887 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,889 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,889 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 22:03:47,892 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:47,894 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1, FileablePath, hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2, FileablePath, hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/recovered.edits] 2023-02-11 22:03:47,896 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1/0bcdcb7d61d64482b12597bcf6715a4d to hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/archive/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1/0bcdcb7d61d64482b12597bcf6715a4d 2023-02-11 22:03:47,897 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1/8795524139ee4a64a90be7424aeae5ff to hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/archive/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f1/8795524139ee4a64a90be7424aeae5ff 2023-02-11 22:03:47,899 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2/045511c86e6a45a890c5fce97dde20da to hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/archive/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2/045511c86e6a45a890c5fce97dde20da 2023-02-11 22:03:47,900 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2/0cb870885de6420b8f0cb380ff580956 to hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/archive/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/f2/0cb870885de6420b8f0cb380ff580956 2023-02-11 22:03:47,902 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/recovered.edits/12.seqid to hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/archive/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880/recovered.edits/12.seqid 2023-02-11 22:03:47,903 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/.tmp/data/default/testWithMockedMapReduceSingleRegion/fdff4182ad4e0fc1f2a96d21b5fb0880 2023-02-11 22:03:47,903 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-11 22:03:47,906 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,907 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-11 22:03:47,908 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-11 22:03:47,909 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,909 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-11 22:03:47,909 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153027909"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:47,910 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 22:03:47,910 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fdff4182ad4e0fc1f2a96d21b5fb0880, NAME => 'testWithMockedMapReduceSingleRegion,,1676153026140.fdff4182ad4e0fc1f2a96d21b5fb0880.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 22:03:47,910 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-11 22:03:47,910 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676153027910"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:47,911 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-11 22:03:47,913 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 22:03:47,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 26 msec 2023-02-11 22:03:47,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41571] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 22:03:47,991 INFO [Listener at localhost/45513] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-11 22:03:47,991 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 22:03:47,991 INFO [Listener at localhost/45513] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 22:03:47,992 DEBUG [Listener at localhost/45513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d6cbb43 to 127.0.0.1:53693 2023-02-11 22:03:47,992 DEBUG [Listener at localhost/45513] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:47,992 DEBUG [Listener at localhost/45513] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 22:03:47,992 DEBUG [Listener at localhost/45513] util.JVMClusterUtil(257): Found active master hash=679626146, stopped=false 2023-02-11 22:03:47,992 INFO [Listener at localhost/45513] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,41571,1676153025022 2023-02-11 22:03:47,994 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:47,994 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:47,994 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:47,994 INFO [Listener at localhost/45513] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 22:03:47,994 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:47,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:47,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:47,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:47,996 DEBUG [Listener at localhost/45513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6be4d638 to 127.0.0.1:53693 2023-02-11 22:03:47,996 DEBUG [Listener at localhost/45513] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:47,996 INFO [Listener at localhost/45513] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,37599,1676153025072' ***** 2023-02-11 22:03:47,997 INFO [Listener at localhost/45513] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:47,997 INFO [Listener at localhost/45513] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,44297,1676153025101' ***** 2023-02-11 22:03:47,997 INFO [Listener at localhost/45513] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:47,997 INFO [RS:0;jenkins-hbase9:37599] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:47,997 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:47,997 INFO [RS:0;jenkins-hbase9:37599] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:47,998 INFO [RS:0;jenkins-hbase9:37599] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:47,998 INFO [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(3304): Received CLOSE for 80fc27bf8096829cf38e6dfe8f371b20 2023-02-11 22:03:47,998 INFO [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:47,998 DEBUG [RS:0;jenkins-hbase9:37599] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ef58fea to 127.0.0.1:53693 2023-02-11 22:03:47,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 80fc27bf8096829cf38e6dfe8f371b20, disabling compactions & flushes 2023-02-11 22:03:47,998 INFO [RS:1;jenkins-hbase9:44297] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:47,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. 2023-02-11 22:03:47,998 INFO [RS:1;jenkins-hbase9:44297] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:47,998 DEBUG [RS:0;jenkins-hbase9:37599] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:47,998 INFO [RS:1;jenkins-hbase9:44297] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:47,998 INFO [RS:0;jenkins-hbase9:37599] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:47,998 INFO [RS:0;jenkins-hbase9:37599] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:47,998 INFO [RS:0;jenkins-hbase9:37599] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:47,998 INFO [RS:1;jenkins-hbase9:44297] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:47,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. 2023-02-11 22:03:47,998 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:47,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. after waiting 0 ms 2023-02-11 22:03:47,999 DEBUG [RS:1;jenkins-hbase9:44297] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x303702e3 to 127.0.0.1:53693 2023-02-11 22:03:47,999 INFO [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 22:03:47,999 DEBUG [RS:1;jenkins-hbase9:44297] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:47,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. 2023-02-11 22:03:47,999 INFO [RS:1;jenkins-hbase9:44297] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,44297,1676153025101; all regions closed. 2023-02-11 22:03:48,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 80fc27bf8096829cf38e6dfe8f371b20 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 22:03:48,000 INFO [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-11 22:03:48,000 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:48,000 DEBUG [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(1479): Online Regions={80fc27bf8096829cf38e6dfe8f371b20=hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20., 1588230740=hbase:meta,,1.1588230740} 2023-02-11 22:03:48,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:48,000 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:48,000 DEBUG [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(1505): Waiting on 1588230740, 80fc27bf8096829cf38e6dfe8f371b20 2023-02-11 22:03:48,000 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:48,000 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:48,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-11 22:03:48,003 DEBUG [RS:1;jenkins-hbase9:44297] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/oldWALs 2023-02-11 22:03:48,003 INFO [RS:1;jenkins-hbase9:44297] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C44297%2C1676153025101:(num 1676153026416) 2023-02-11 22:03:48,003 DEBUG [RS:1;jenkins-hbase9:44297] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:48,003 INFO [RS:1;jenkins-hbase9:44297] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:48,004 INFO [RS:1;jenkins-hbase9:44297] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:48,004 INFO [RS:1;jenkins-hbase9:44297] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:48,004 INFO [RS:1;jenkins-hbase9:44297] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:48,004 INFO [RS:1;jenkins-hbase9:44297] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:48,004 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:48,005 INFO [RS:1;jenkins-hbase9:44297] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:44297 2023-02-11 22:03:48,009 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:48,009 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44297,1676153025101 2023-02-11 22:03:48,009 ERROR [Listener at localhost/45513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@79c46e9f rejected from java.util.concurrent.ThreadPoolExecutor@7dfbe57f[Terminated, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:48,009 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:48,009 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:48,009 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:48,009 ERROR [Listener at localhost/45513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5361e642 rejected from java.util.concurrent.ThreadPoolExecutor@7dfbe57f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:48,011 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,44297,1676153025101] 2023-02-11 22:03:48,011 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,44297,1676153025101; numProcessing=1 2023-02-11 22:03:48,013 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,44297,1676153025101 already deleted, retry=false 2023-02-11 22:03:48,013 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,44297,1676153025101 expired; onlineServers=1 2023-02-11 22:03:48,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20/.tmp/info/8ab0c53c637f445ba3710f8fd90fb037 2023-02-11 22:03:48,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/.tmp/info/8cb91d53723940b89b88bd3890991b69 2023-02-11 22:03:48,017 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cb91d53723940b89b88bd3890991b69 2023-02-11 22:03:48,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20/.tmp/info/8ab0c53c637f445ba3710f8fd90fb037 as hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20/info/8ab0c53c637f445ba3710f8fd90fb037 2023-02-11 22:03:48,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20/info/8ab0c53c637f445ba3710f8fd90fb037, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 22:03:48,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 80fc27bf8096829cf38e6dfe8f371b20 in 22ms, sequenceid=6, compaction requested=false 2023-02-11 22:03:48,024 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/.tmp/rep_barrier/594c9327042742cfb562bae68c91ac83 2023-02-11 22:03:48,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/namespace/80fc27bf8096829cf38e6dfe8f371b20/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 22:03:48,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. 2023-02-11 22:03:48,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 80fc27bf8096829cf38e6dfe8f371b20: Waiting for close lock at 1676153027998Running coprocessor pre-close hooks at 1676153027998Disabling compacts and flushes for region at 1676153027998Disabling writes for close at 1676153027999 (+1 ms)Obtaining lock to block concurrent updates at 1676153028000 (+1 ms)Preparing flush snapshotting stores in 80fc27bf8096829cf38e6dfe8f371b20 at 1676153028000Finished memstore snapshotting hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676153028000Flushing stores of hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. at 1676153028000Flushing 80fc27bf8096829cf38e6dfe8f371b20/info: creating writer at 1676153028000Flushing 80fc27bf8096829cf38e6dfe8f371b20/info: appending metadata at 1676153028003 (+3 ms)Flushing 80fc27bf8096829cf38e6dfe8f371b20/info: closing flushed file at 1676153028003Flushing 80fc27bf8096829cf38e6dfe8f371b20/info: reopening flushed file at 1676153028018 (+15 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 80fc27bf8096829cf38e6dfe8f371b20 in 22ms, sequenceid=6, compaction requested=false at 1676153028022 (+4 ms)Writing region close event to WAL at 1676153028023 (+1 ms)Running coprocessor post-close hooks at 1676153028025 (+2 ms)Closed at 1676153028026 (+1 ms) 2023-02-11 22:03:48,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676153025649.80fc27bf8096829cf38e6dfe8f371b20. 2023-02-11 22:03:48,027 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 594c9327042742cfb562bae68c91ac83 2023-02-11 22:03:48,045 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/.tmp/table/8374168f0c7c4ba8bbfb81760fe372cf 2023-02-11 22:03:48,048 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8374168f0c7c4ba8bbfb81760fe372cf 2023-02-11 22:03:48,049 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/.tmp/info/8cb91d53723940b89b88bd3890991b69 as hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/info/8cb91d53723940b89b88bd3890991b69 2023-02-11 22:03:48,052 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cb91d53723940b89b88bd3890991b69 2023-02-11 22:03:48,053 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/info/8cb91d53723940b89b88bd3890991b69, entries=12, sequenceid=21, filesize=6.3 K 2023-02-11 22:03:48,053 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/.tmp/rep_barrier/594c9327042742cfb562bae68c91ac83 as hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/rep_barrier/594c9327042742cfb562bae68c91ac83 2023-02-11 22:03:48,057 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 594c9327042742cfb562bae68c91ac83 2023-02-11 22:03:48,057 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/rep_barrier/594c9327042742cfb562bae68c91ac83, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 22:03:48,057 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/.tmp/table/8374168f0c7c4ba8bbfb81760fe372cf as hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/table/8374168f0c7c4ba8bbfb81760fe372cf 2023-02-11 22:03:48,060 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8374168f0c7c4ba8bbfb81760fe372cf 2023-02-11 22:03:48,060 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/table/8374168f0c7c4ba8bbfb81760fe372cf, entries=4, sequenceid=21, filesize=5.1 K 2023-02-11 22:03:48,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 64ms, sequenceid=21, compaction requested=false 2023-02-11 22:03:48,067 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-11 22:03:48,067 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 22:03:48,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:48,068 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153028000Running coprocessor pre-close hooks at 1676153028000Disabling compacts and flushes for region at 1676153028000Disabling writes for close at 1676153028000Obtaining lock to block concurrent updates at 1676153028000Preparing flush snapshotting stores in 1588230740 at 1676153028000Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676153028000Flushing stores of hbase:meta,,1.1588230740 at 1676153028001 (+1 ms)Flushing 1588230740/info: creating writer at 1676153028001Flushing 1588230740/info: appending metadata at 1676153028004 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676153028004Flushing 1588230740/rep_barrier: creating writer at 1676153028017 (+13 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676153028019 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676153028019Flushing 1588230740/table: creating writer at 1676153028028 (+9 ms)Flushing 1588230740/table: appending metadata at 1676153028029 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676153028029Flushing 1588230740/info: reopening flushed file at 1676153028049 (+20 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676153028054 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676153028058 (+4 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 64ms, sequenceid=21, compaction requested=false at 1676153028064 (+6 ms)Writing region close event to WAL at 1676153028065 (+1 ms)Running coprocessor post-close hooks at 1676153028067 (+2 ms)Closed at 1676153028068 (+1 ms) 2023-02-11 22:03:48,068 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:48,080 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:48,081 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:48,194 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:48,194 INFO [RS:1;jenkins-hbase9:44297] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,44297,1676153025101; zookeeper connection closed. 2023-02-11 22:03:48,194 ERROR [Listener at localhost/45513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2bf90674 rejected from java.util.concurrent.ThreadPoolExecutor@7dfbe57f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:48,195 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:44297-0x100456a51da0002, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:48,195 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3e47a5e6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3e47a5e6 2023-02-11 22:03:48,195 ERROR [Listener at localhost/45513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4592545 rejected from java.util.concurrent.ThreadPoolExecutor@7dfbe57f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:48,200 INFO [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,37599,1676153025072; all regions closed. 2023-02-11 22:03:48,205 DEBUG [RS:0;jenkins-hbase9:37599] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/oldWALs 2023-02-11 22:03:48,206 INFO [RS:0;jenkins-hbase9:37599] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C37599%2C1676153025072.meta:.meta(num 1676153025603) 2023-02-11 22:03:48,209 DEBUG [RS:0;jenkins-hbase9:37599] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/oldWALs 2023-02-11 22:03:48,209 INFO [RS:0;jenkins-hbase9:37599] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C37599%2C1676153025072:(num 1676153025990) 2023-02-11 22:03:48,209 DEBUG [RS:0;jenkins-hbase9:37599] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:48,209 INFO [RS:0;jenkins-hbase9:37599] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:48,209 INFO [RS:0;jenkins-hbase9:37599] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:48,209 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:48,210 INFO [RS:0;jenkins-hbase9:37599] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:37599 2023-02-11 22:03:48,213 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,37599,1676153025072 2023-02-11 22:03:48,213 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:48,213 ERROR [Listener at localhost/45513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b613db5 rejected from java.util.concurrent.ThreadPoolExecutor@5f5eb201[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:48,214 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,37599,1676153025072] 2023-02-11 22:03:48,214 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,37599,1676153025072; numProcessing=2 2023-02-11 22:03:48,215 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,37599,1676153025072 already deleted, retry=false 2023-02-11 22:03:48,215 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,37599,1676153025072 expired; onlineServers=0 2023-02-11 22:03:48,215 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,41571,1676153025022' ***** 2023-02-11 22:03:48,215 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 22:03:48,216 DEBUG [M:0;jenkins-hbase9:41571] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cbdc46a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:48,216 INFO [M:0;jenkins-hbase9:41571] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,41571,1676153025022 2023-02-11 22:03:48,216 INFO [M:0;jenkins-hbase9:41571] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,41571,1676153025022; all regions closed. 2023-02-11 22:03:48,216 DEBUG [M:0;jenkins-hbase9:41571] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:48,216 DEBUG [M:0;jenkins-hbase9:41571] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 22:03:48,216 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 22:03:48,216 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153025245] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153025245,5,FailOnTimeoutGroup] 2023-02-11 22:03:48,216 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153025245] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153025245,5,FailOnTimeoutGroup] 2023-02-11 22:03:48,216 DEBUG [M:0;jenkins-hbase9:41571] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 22:03:48,217 INFO [M:0;jenkins-hbase9:41571] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 22:03:48,217 INFO [M:0;jenkins-hbase9:41571] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 22:03:48,217 INFO [M:0;jenkins-hbase9:41571] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-11 22:03:48,217 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:48,217 DEBUG [M:0;jenkins-hbase9:41571] master.HMaster(1502): Stopping service threads 2023-02-11 22:03:48,218 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:48,218 INFO [M:0;jenkins-hbase9:41571] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 22:03:48,218 ERROR [M:0;jenkins-hbase9:41571] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 22:03:48,218 INFO [M:0;jenkins-hbase9:41571] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 22:03:48,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:48,218 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 22:03:48,219 DEBUG [M:0;jenkins-hbase9:41571] zookeeper.ZKUtil(398): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 22:03:48,219 WARN [M:0;jenkins-hbase9:41571] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 22:03:48,219 INFO [M:0;jenkins-hbase9:41571] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 22:03:48,219 INFO [M:0;jenkins-hbase9:41571] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 22:03:48,219 DEBUG [M:0;jenkins-hbase9:41571] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:48,220 INFO [M:0;jenkins-hbase9:41571] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:48,220 DEBUG [M:0;jenkins-hbase9:41571] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:48,220 DEBUG [M:0;jenkins-hbase9:41571] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:48,220 DEBUG [M:0;jenkins-hbase9:41571] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:48,220 INFO [M:0;jenkins-hbase9:41571] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.10 KB heapSize=67.06 KB 2023-02-11 22:03:48,229 INFO [M:0;jenkins-hbase9:41571] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.10 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d9666911560d43d88ea11f7ca8f4b1a6 2023-02-11 22:03:48,233 DEBUG [M:0;jenkins-hbase9:41571] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d9666911560d43d88ea11f7ca8f4b1a6 as hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d9666911560d43d88ea11f7ca8f4b1a6 2023-02-11 22:03:48,236 INFO [M:0;jenkins-hbase9:41571] regionserver.HStore(1080): Added hdfs://localhost:41845/user/jenkins/test-data/84d929f8-0872-6e02-8f35-847aa958debf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d9666911560d43d88ea11f7ca8f4b1a6, entries=17, sequenceid=132, filesize=8.7 K 2023-02-11 22:03:48,237 INFO [M:0;jenkins-hbase9:41571] regionserver.HRegion(2947): Finished flush of dataSize ~56.10 KB/57443, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-11 22:03:48,238 INFO [M:0;jenkins-hbase9:41571] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:48,238 DEBUG [M:0;jenkins-hbase9:41571] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153028219Disabling compacts and flushes for region at 1676153028219Disabling writes for close at 1676153028220 (+1 ms)Obtaining lock to block concurrent updates at 1676153028220Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676153028220Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57443, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1676153028220Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676153028221 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676153028221Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676153028223 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676153028223Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676153028233 (+10 ms)Finished flush of dataSize ~56.10 KB/57443, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1676153028237 (+4 ms)Writing region close event to WAL at 1676153028238 (+1 ms)Closed at 1676153028238 2023-02-11 22:03:48,240 INFO [M:0;jenkins-hbase9:41571] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 22:03:48,240 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:48,241 INFO [M:0;jenkins-hbase9:41571] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41571 2023-02-11 22:03:48,243 DEBUG [M:0;jenkins-hbase9:41571] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,41571,1676153025022 already deleted, retry=false 2023-02-11 22:03:48,595 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:48,595 INFO [M:0;jenkins-hbase9:41571] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,41571,1676153025022; zookeeper connection closed. 2023-02-11 22:03:48,595 ERROR [Listener at localhost/45513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e947b20 rejected from java.util.concurrent.ThreadPoolExecutor@6aabf22a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:48,598 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): master:41571-0x100456a51da0000, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:48,598 ERROR [Listener at localhost/45513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@534ca4fd rejected from java.util.concurrent.ThreadPoolExecutor@6aabf22a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:48,696 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:48,696 INFO [RS:0;jenkins-hbase9:37599] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,37599,1676153025072; zookeeper connection closed. 2023-02-11 22:03:48,696 ERROR [Listener at localhost/45513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@79d208e5 rejected from java.util.concurrent.ThreadPoolExecutor@5f5eb201[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:48,696 DEBUG [Listener at localhost/45513-EventThread] zookeeper.ZKWatcher(600): regionserver:37599-0x100456a51da0001, quorum=127.0.0.1:53693, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:48,696 ERROR [Listener at localhost/45513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1686f25 rejected from java.util.concurrent.ThreadPoolExecutor@5f5eb201[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:48,696 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7a262501] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7a262501 2023-02-11 22:03:48,697 INFO [Listener at localhost/45513] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 22:03:48,697 WARN [Listener at localhost/45513] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:48,702 INFO [Listener at localhost/45513] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:48,808 WARN [BP-737617074-172.31.2.10-1676153024250 heartbeating to localhost/127.0.0.1:41845] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:48,808 WARN [BP-737617074-172.31.2.10-1676153024250 heartbeating to localhost/127.0.0.1:41845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-737617074-172.31.2.10-1676153024250 (Datanode Uuid 7efd3b99-efbe-4702-a5fd-1aca2c528797) service to localhost/127.0.0.1:41845 2023-02-11 22:03:48,809 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/cluster_52d53346-f170-5af0-daff-196782343850/dfs/data/data3/current/BP-737617074-172.31.2.10-1676153024250] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:48,809 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/cluster_52d53346-f170-5af0-daff-196782343850/dfs/data/data4/current/BP-737617074-172.31.2.10-1676153024250] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:48,811 WARN [Listener at localhost/45513] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:48,814 INFO [Listener at localhost/45513] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:48,865 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 22:03:48,918 WARN [BP-737617074-172.31.2.10-1676153024250 heartbeating to localhost/127.0.0.1:41845] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:48,919 WARN [BP-737617074-172.31.2.10-1676153024250 heartbeating to localhost/127.0.0.1:41845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-737617074-172.31.2.10-1676153024250 (Datanode Uuid bc411d7c-bf34-4698-9624-be8b2519af14) service to localhost/127.0.0.1:41845 2023-02-11 22:03:48,919 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/cluster_52d53346-f170-5af0-daff-196782343850/dfs/data/data1/current/BP-737617074-172.31.2.10-1676153024250] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:48,919 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/cluster_52d53346-f170-5af0-daff-196782343850/dfs/data/data2/current/BP-737617074-172.31.2.10-1676153024250] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:48,929 INFO [Listener at localhost/45513] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:49,042 INFO [Listener at localhost/45513] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 22:03:49,061 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 22:03:49,073 INFO [Listener at localhost/45513] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=252 (was 227) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:41845 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:41845 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,41571,1676153025022)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:41845 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41845 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45513 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45513.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:41845 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:41845 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'NameNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:41845 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=661 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=286 (was 302), ProcessCount=166 (was 166), AvailableMemoryMB=9626 (was 9645) 2023-02-11 22:03:49,083 INFO [Listener at localhost/45513] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=252, OpenFileDescriptor=661, MaxFileDescriptor=60000, SystemLoadAverage=286, ProcessCount=166, AvailableMemoryMB=9626 2023-02-11 22:03:49,093 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/hadoop.log.dir so I do NOT create it in target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d 2023-02-11 22:03:49,093 WARN [Listener at localhost/45513] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 22:03:49,093 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/hadoop.tmp.dir so I do NOT create it in target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d 2023-02-11 22:03:49,093 WARN [Listener at localhost/45513] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a90289a2-81f2-d7c0-55e4-a4b4c5c036a8/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 22:03:49,093 DEBUG [Listener at localhost/45513] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d 2023-02-11 22:03:49,094 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 22:03:49,094 INFO [Listener at localhost/45513] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/cluster_671774f5-443c-f981-5428-0cb7467049e2, deleteOnExit=true 2023-02-11 22:03:49,094 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 22:03:49,094 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/test.cache.data in system properties and HBase conf 2023-02-11 22:03:49,094 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 22:03:49,094 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/hadoop.log.dir in system properties and HBase conf 2023-02-11 22:03:49,094 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 22:03:49,094 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 22:03:49,094 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 22:03:49,094 DEBUG [Listener at localhost/45513] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 22:03:49,094 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:49,095 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:49,095 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 22:03:49,095 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:49,095 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 22:03:49,095 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 22:03:49,095 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:49,095 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:49,095 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 22:03:49,095 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/nfs.dump.dir in system properties and HBase conf 2023-02-11 22:03:49,095 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/java.io.tmpdir in system properties and HBase conf 2023-02-11 22:03:49,096 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:49,096 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 22:03:49,096 INFO [Listener at localhost/45513] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 22:03:49,100 WARN [Listener at localhost/45513] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:49,100 WARN [Listener at localhost/45513] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:49,138 WARN [Listener at localhost/45513] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:49,140 INFO [Listener at localhost/45513] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:49,144 INFO [Listener at localhost/45513] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/java.io.tmpdir/Jetty_localhost_43731_hdfs____gdqffk/webapp 2023-02-11 22:03:49,235 INFO [Listener at localhost/45513] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43731 2023-02-11 22:03:49,240 WARN [Listener at localhost/45513] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:49,240 WARN [Listener at localhost/45513] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:49,287 WARN [Listener at localhost/38107] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:49,300 WARN [Listener at localhost/38107] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:49,302 WARN [Listener at localhost/38107] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:49,302 INFO [Listener at localhost/38107] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:49,310 INFO [Listener at localhost/38107] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/java.io.tmpdir/Jetty_localhost_33141_datanode____n3f8xh/webapp 2023-02-11 22:03:49,402 INFO [Listener at localhost/38107] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33141 2023-02-11 22:03:49,409 WARN [Listener at localhost/40399] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:49,427 WARN [Listener at localhost/40399] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:49,429 WARN [Listener at localhost/40399] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:49,430 INFO [Listener at localhost/40399] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:49,432 INFO [Listener at localhost/40399] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/java.io.tmpdir/Jetty_localhost_44085_datanode____ua0r9w/webapp 2023-02-11 22:03:49,516 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd1b2d85ed7162e2a: Processing first storage report for DS-fc47acf9-fc61-46ef-9ceb-21bcc7eccbd2 from datanode 0326391d-ef29-4180-ae8a-2b4880ac0284 2023-02-11 22:03:49,516 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd1b2d85ed7162e2a: from storage DS-fc47acf9-fc61-46ef-9ceb-21bcc7eccbd2 node DatanodeRegistration(127.0.0.1:46243, datanodeUuid=0326391d-ef29-4180-ae8a-2b4880ac0284, infoPort=39691, infoSecurePort=0, ipcPort=40399, storageInfo=lv=-57;cid=testClusterID;nsid=164862958;c=1676153029102), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:49,516 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd1b2d85ed7162e2a: Processing first storage report for DS-b9e419f6-7125-4f2a-a8e9-80e208bc1d88 from datanode 0326391d-ef29-4180-ae8a-2b4880ac0284 2023-02-11 22:03:49,516 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd1b2d85ed7162e2a: from storage DS-b9e419f6-7125-4f2a-a8e9-80e208bc1d88 node DatanodeRegistration(127.0.0.1:46243, datanodeUuid=0326391d-ef29-4180-ae8a-2b4880ac0284, infoPort=39691, infoSecurePort=0, ipcPort=40399, storageInfo=lv=-57;cid=testClusterID;nsid=164862958;c=1676153029102), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:49,529 INFO [Listener at localhost/40399] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44085 2023-02-11 22:03:49,536 WARN [Listener at localhost/39979] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:49,684 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x74ba3537c7388241: Processing first storage report for DS-1cecffa4-1f44-453b-9808-e537707956f2 from datanode 84172317-9047-4461-81f3-e0f7ebe2c81b 2023-02-11 22:03:49,684 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x74ba3537c7388241: from storage DS-1cecffa4-1f44-453b-9808-e537707956f2 node DatanodeRegistration(127.0.0.1:46483, datanodeUuid=84172317-9047-4461-81f3-e0f7ebe2c81b, infoPort=35337, infoSecurePort=0, ipcPort=39979, storageInfo=lv=-57;cid=testClusterID;nsid=164862958;c=1676153029102), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:49,684 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x74ba3537c7388241: Processing first storage report for DS-56ad5604-b3af-44b0-854a-e25aff65aeec from datanode 84172317-9047-4461-81f3-e0f7ebe2c81b 2023-02-11 22:03:49,684 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x74ba3537c7388241: from storage DS-56ad5604-b3af-44b0-854a-e25aff65aeec node DatanodeRegistration(127.0.0.1:46483, datanodeUuid=84172317-9047-4461-81f3-e0f7ebe2c81b, infoPort=35337, infoSecurePort=0, ipcPort=39979, storageInfo=lv=-57;cid=testClusterID;nsid=164862958;c=1676153029102), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:49,686 DEBUG [Listener at localhost/39979] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d 2023-02-11 22:03:49,689 INFO [Listener at localhost/39979] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/cluster_671774f5-443c-f981-5428-0cb7467049e2/zookeeper_0, clientPort=52653, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/cluster_671774f5-443c-f981-5428-0cb7467049e2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/cluster_671774f5-443c-f981-5428-0cb7467049e2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 22:03:49,691 INFO [Listener at localhost/39979] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52653 2023-02-11 22:03:49,691 INFO [Listener at localhost/39979] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:49,692 INFO [Listener at localhost/39979] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:49,710 INFO [Listener at localhost/39979] util.FSUtils(479): Created version file at hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c with version=8 2023-02-11 22:03:49,711 INFO [Listener at localhost/39979] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:49,712 INFO [Listener at localhost/39979] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:49,713 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38107/user/jenkins/test-data/5e021fe0-07ed-47b5-a621-9fc24578dafd/hbase-staging 2023-02-11 22:03:49,715 INFO [Listener at localhost/39979] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:49,715 INFO [Listener at localhost/39979] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:49,715 INFO [Listener at localhost/39979] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:49,715 INFO [Listener at localhost/39979] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:49,715 INFO [Listener at localhost/39979] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:49,715 INFO [Listener at localhost/39979] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:49,715 INFO [Listener at localhost/39979] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:49,716 INFO [Listener at localhost/39979] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35753 2023-02-11 22:03:49,717 INFO [Listener at localhost/39979] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:49,717 INFO [Listener at localhost/39979] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:49,718 INFO [Listener at localhost/39979] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35753 connecting to ZooKeeper ensemble=127.0.0.1:52653 2023-02-11 22:03:49,726 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:357530x0, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:49,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35753-0x100456a64250000 connected 2023-02-11 22:03:49,743 DEBUG [Listener at localhost/39979] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:49,744 DEBUG [Listener at localhost/39979] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:49,744 DEBUG [Listener at localhost/39979] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:49,747 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35753 2023-02-11 22:03:49,747 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35753 2023-02-11 22:03:49,748 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35753 2023-02-11 22:03:49,751 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35753 2023-02-11 22:03:49,751 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35753 2023-02-11 22:03:49,751 INFO [Listener at localhost/39979] master.HMaster(439): hbase.rootdir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c, hbase.cluster.distributed=false 2023-02-11 22:03:49,765 INFO [Listener at localhost/39979] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:49,765 INFO [Listener at localhost/39979] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:49,765 INFO [Listener at localhost/39979] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:49,765 INFO [Listener at localhost/39979] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:49,765 INFO [Listener at localhost/39979] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:49,765 INFO [Listener at localhost/39979] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:49,765 INFO [Listener at localhost/39979] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:49,766 INFO [Listener at localhost/39979] ipc.NettyRpcServer(120): Bind to /172.31.2.10:33013 2023-02-11 22:03:49,766 INFO [Listener at localhost/39979] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:49,767 DEBUG [Listener at localhost/39979] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:49,767 INFO [Listener at localhost/39979] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:49,768 INFO [Listener at localhost/39979] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:49,769 INFO [Listener at localhost/39979] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33013 connecting to ZooKeeper ensemble=127.0.0.1:52653 2023-02-11 22:03:49,771 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:330130x0, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:49,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33013-0x100456a64250001 connected 2023-02-11 22:03:49,773 DEBUG [Listener at localhost/39979] zookeeper.ZKUtil(164): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:49,773 DEBUG [Listener at localhost/39979] zookeeper.ZKUtil(164): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:49,773 DEBUG [Listener at localhost/39979] zookeeper.ZKUtil(164): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:49,776 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33013 2023-02-11 22:03:49,776 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33013 2023-02-11 22:03:49,776 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33013 2023-02-11 22:03:49,777 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33013 2023-02-11 22:03:49,779 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33013 2023-02-11 22:03:49,790 INFO [Listener at localhost/39979] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:49,790 INFO [Listener at localhost/39979] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:49,790 INFO [Listener at localhost/39979] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:49,790 INFO [Listener at localhost/39979] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:49,790 INFO [Listener at localhost/39979] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:49,790 INFO [Listener at localhost/39979] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:49,790 INFO [Listener at localhost/39979] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:49,791 INFO [Listener at localhost/39979] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41227 2023-02-11 22:03:49,791 INFO [Listener at localhost/39979] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:49,794 DEBUG [Listener at localhost/39979] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:49,794 INFO [Listener at localhost/39979] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:49,796 INFO [Listener at localhost/39979] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:49,797 INFO [Listener at localhost/39979] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41227 connecting to ZooKeeper ensemble=127.0.0.1:52653 2023-02-11 22:03:49,801 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:412270x0, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:49,801 DEBUG [Listener at localhost/39979] zookeeper.ZKUtil(164): regionserver:412270x0, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:49,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41227-0x100456a64250002 connected 2023-02-11 22:03:49,802 DEBUG [Listener at localhost/39979] zookeeper.ZKUtil(164): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:49,803 DEBUG [Listener at localhost/39979] zookeeper.ZKUtil(164): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:49,807 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41227 2023-02-11 22:03:49,807 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41227 2023-02-11 22:03:49,807 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41227 2023-02-11 22:03:49,811 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41227 2023-02-11 22:03:49,813 DEBUG [Listener at localhost/39979] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41227 2023-02-11 22:03:49,815 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,35753,1676153029714 2023-02-11 22:03:49,816 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:49,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,35753,1676153029714 2023-02-11 22:03:49,819 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:49,819 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:49,819 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:49,821 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:49,821 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:49,824 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,35753,1676153029714 from backup master directory 2023-02-11 22:03:49,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:49,825 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,35753,1676153029714 2023-02-11 22:03:49,825 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:49,825 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:49,825 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,35753,1676153029714 2023-02-11 22:03:49,842 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/hbase.id with ID: 83c28d42-3dbb-40d1-8aa8-eca3a5ce2755 2023-02-11 22:03:49,850 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:49,853 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:49,861 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5bb3cbca to 127.0.0.1:52653 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:49,865 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42fd46f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:49,865 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:49,866 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 22:03:49,867 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:49,868 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/data/master/store-tmp 2023-02-11 22:03:49,879 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:49,879 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:49,879 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:49,879 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:49,879 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:49,879 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:49,880 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:49,880 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153029879Disabling compacts and flushes for region at 1676153029879Disabling writes for close at 1676153029879Writing region close event to WAL at 1676153029880 (+1 ms)Closed at 1676153029880 2023-02-11 22:03:49,880 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/WALs/jenkins-hbase9.apache.org,35753,1676153029714 2023-02-11 22:03:49,882 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35753%2C1676153029714, suffix=, logDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/WALs/jenkins-hbase9.apache.org,35753,1676153029714, archiveDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/oldWALs, maxLogs=10 2023-02-11 22:03:49,894 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46243,DS-fc47acf9-fc61-46ef-9ceb-21bcc7eccbd2,DISK] 2023-02-11 22:03:49,894 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46483,DS-1cecffa4-1f44-453b-9808-e537707956f2,DISK] 2023-02-11 22:03:49,896 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/WALs/jenkins-hbase9.apache.org,35753,1676153029714/jenkins-hbase9.apache.org%2C35753%2C1676153029714.1676153029882 2023-02-11 22:03:49,896 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46243,DS-fc47acf9-fc61-46ef-9ceb-21bcc7eccbd2,DISK], DatanodeInfoWithStorage[127.0.0.1:46483,DS-1cecffa4-1f44-453b-9808-e537707956f2,DISK]] 2023-02-11 22:03:49,896 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:49,896 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:49,896 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:49,896 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:49,899 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:49,900 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 22:03:49,900 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 22:03:49,901 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:49,901 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:49,902 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:49,903 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:49,907 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:49,907 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60667016, jitterRate=-0.09599101543426514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:49,908 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676153029896Initializing all the Stores at 1676153029897 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153029897Cleaning up temporary data from old regions at 1676153029902 (+5 ms)Cleaning up detritus from prior splits at 1676153029902Region opened successfully at 1676153029908 (+6 ms) 2023-02-11 22:03:49,908 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 22:03:49,909 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 22:03:49,909 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 22:03:49,909 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 22:03:49,909 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 22:03:49,910 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 22:03:49,910 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 22:03:49,910 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 22:03:49,911 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 22:03:49,921 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 22:03:49,921 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 22:03:49,921 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 22:03:49,921 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 22:03:49,922 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 22:03:49,924 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:49,924 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 22:03:49,924 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 22:03:49,925 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 22:03:49,926 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:49,926 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:49,926 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:49,926 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:49,927 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,35753,1676153029714, sessionid=0x100456a64250000, setting cluster-up flag (Was=false) 2023-02-11 22:03:49,931 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:49,935 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 22:03:49,936 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35753,1676153029714 2023-02-11 22:03:49,939 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:49,942 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 22:03:49,942 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35753,1676153029714 2023-02-11 22:03:49,942 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.hbase-snapshot/.tmp 2023-02-11 22:03:49,944 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:49,944 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:49,944 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:49,944 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:49,944 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:49,944 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-11 22:03:49,944 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:49,944 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:49,944 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:49,945 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676153059945 2023-02-11 22:03:49,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 22:03:49,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 22:03:49,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 22:03:49,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 22:03:49,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 22:03:49,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 22:03:49,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:49,946 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:49,946 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 22:03:49,947 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 22:03:49,947 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 22:03:49,947 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 22:03:49,947 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:49,951 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 22:03:49,951 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 22:03:49,951 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153029951,5,FailOnTimeoutGroup] 2023-02-11 22:03:49,951 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153029951,5,FailOnTimeoutGroup] 2023-02-11 22:03:49,951 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:49,952 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 22:03:49,952 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:49,952 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:49,959 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:49,960 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:49,960 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c 2023-02-11 22:03:49,967 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:49,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:49,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/info 2023-02-11 22:03:49,969 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:49,969 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:49,969 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:49,970 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:49,970 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:49,970 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:49,970 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:49,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/table 2023-02-11 22:03:49,971 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:49,972 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:49,972 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740 2023-02-11 22:03:49,972 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740 2023-02-11 22:03:49,974 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:49,974 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:49,976 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:49,976 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70787335, jitterRate=0.05481348931789398}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:49,976 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676153029967Initializing all the Stores at 1676153029967Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153029967Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153029968 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153029968Cleaning up temporary data from old regions at 1676153029973 (+5 ms)Cleaning up detritus from prior splits at 1676153029973Region opened successfully at 1676153029976 (+3 ms) 2023-02-11 22:03:49,976 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:49,977 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:49,977 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:49,977 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:49,977 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:49,977 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:49,977 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153029976Disabling compacts and flushes for region at 1676153029976Disabling writes for close at 1676153029977 (+1 ms)Writing region close event to WAL at 1676153029977Closed at 1676153029977 2023-02-11 22:03:49,977 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:49,977 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 22:03:49,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 22:03:49,979 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 22:03:49,980 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 22:03:50,015 INFO [RS:0;jenkins-hbase9:33013] regionserver.HRegionServer(952): ClusterId : 83c28d42-3dbb-40d1-8aa8-eca3a5ce2755 2023-02-11 22:03:50,015 INFO [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(952): ClusterId : 83c28d42-3dbb-40d1-8aa8-eca3a5ce2755 2023-02-11 22:03:50,016 DEBUG [RS:0;jenkins-hbase9:33013] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:50,016 DEBUG [RS:1;jenkins-hbase9:41227] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:50,018 DEBUG [RS:0;jenkins-hbase9:33013] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:50,019 DEBUG [RS:0;jenkins-hbase9:33013] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:50,018 DEBUG [RS:1;jenkins-hbase9:41227] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:50,019 DEBUG [RS:1;jenkins-hbase9:41227] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:50,020 DEBUG [RS:0;jenkins-hbase9:33013] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:50,021 DEBUG [RS:1;jenkins-hbase9:41227] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:50,021 DEBUG [RS:0;jenkins-hbase9:33013] zookeeper.ReadOnlyZKClient(139): Connect 0x6b50e8ad to 127.0.0.1:52653 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:50,022 DEBUG [RS:1;jenkins-hbase9:41227] zookeeper.ReadOnlyZKClient(139): Connect 0x4f372240 to 127.0.0.1:52653 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:50,024 DEBUG [RS:1;jenkins-hbase9:41227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41f0c5d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:50,024 DEBUG [RS:0;jenkins-hbase9:33013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65970bb7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:50,025 DEBUG [RS:1;jenkins-hbase9:41227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45cf4930, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:50,025 DEBUG [RS:0;jenkins-hbase9:33013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61a883dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:50,033 DEBUG [RS:1;jenkins-hbase9:41227] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:41227 2023-02-11 22:03:50,033 INFO [RS:1;jenkins-hbase9:41227] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:50,033 INFO [RS:1;jenkins-hbase9:41227] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:50,033 DEBUG [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:50,034 INFO [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,35753,1676153029714 with isa=jenkins-hbase9.apache.org/172.31.2.10:41227, startcode=1676153029789 2023-02-11 22:03:50,034 DEBUG [RS:1;jenkins-hbase9:41227] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:50,035 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54771, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:50,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:50,037 DEBUG [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c 2023-02-11 22:03:50,037 DEBUG [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38107 2023-02-11 22:03:50,037 DEBUG [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:50,038 DEBUG [RS:0;jenkins-hbase9:33013] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:33013 2023-02-11 22:03:50,038 INFO [RS:0;jenkins-hbase9:33013] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:50,038 INFO [RS:0;jenkins-hbase9:33013] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:50,038 DEBUG [RS:0;jenkins-hbase9:33013] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:50,040 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:50,040 INFO [RS:0;jenkins-hbase9:33013] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,35753,1676153029714 with isa=jenkins-hbase9.apache.org/172.31.2.10:33013, startcode=1676153029764 2023-02-11 22:03:50,040 DEBUG [RS:1;jenkins-hbase9:41227] zookeeper.ZKUtil(162): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:50,040 DEBUG [RS:0;jenkins-hbase9:33013] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:50,040 WARN [RS:1;jenkins-hbase9:41227] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:50,041 INFO [RS:1;jenkins-hbase9:41227] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:50,041 DEBUG [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/WALs/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:50,041 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,41227,1676153029789] 2023-02-11 22:03:50,044 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42383, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:50,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:50,044 DEBUG [RS:1;jenkins-hbase9:41227] zookeeper.ZKUtil(162): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:50,045 DEBUG [RS:0;jenkins-hbase9:33013] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c 2023-02-11 22:03:50,045 DEBUG [RS:0;jenkins-hbase9:33013] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38107 2023-02-11 22:03:50,045 DEBUG [RS:0;jenkins-hbase9:33013] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:50,048 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:50,048 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:50,048 DEBUG [RS:1;jenkins-hbase9:41227] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:50,048 DEBUG [RS:0;jenkins-hbase9:33013] zookeeper.ZKUtil(162): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:50,048 WARN [RS:0;jenkins-hbase9:33013] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:50,048 INFO [RS:1;jenkins-hbase9:41227] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:50,049 INFO [RS:0;jenkins-hbase9:33013] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:50,049 DEBUG [RS:0;jenkins-hbase9:33013] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/WALs/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:50,050 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,33013,1676153029764] 2023-02-11 22:03:50,050 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:50,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:50,051 INFO [RS:1;jenkins-hbase9:41227] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:50,052 DEBUG [RS:0;jenkins-hbase9:33013] zookeeper.ZKUtil(162): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:50,052 DEBUG [RS:0;jenkins-hbase9:33013] zookeeper.ZKUtil(162): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:50,053 DEBUG [RS:0;jenkins-hbase9:33013] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:50,053 INFO [RS:0;jenkins-hbase9:33013] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:50,054 INFO [RS:1;jenkins-hbase9:41227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:50,054 INFO [RS:1;jenkins-hbase9:41227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,054 INFO [RS:0;jenkins-hbase9:33013] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:50,055 INFO [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:50,055 INFO [RS:0;jenkins-hbase9:33013] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:50,055 INFO [RS:0;jenkins-hbase9:33013] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,056 INFO [RS:0;jenkins-hbase9:33013] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:50,056 INFO [RS:1;jenkins-hbase9:41227] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,057 DEBUG [RS:1;jenkins-hbase9:41227] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,057 DEBUG [RS:1;jenkins-hbase9:41227] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,057 DEBUG [RS:1;jenkins-hbase9:41227] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,057 DEBUG [RS:1;jenkins-hbase9:41227] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,057 DEBUG [RS:1;jenkins-hbase9:41227] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,057 DEBUG [RS:1;jenkins-hbase9:41227] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:50,057 DEBUG [RS:1;jenkins-hbase9:41227] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,057 DEBUG [RS:1;jenkins-hbase9:41227] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,057 INFO [RS:0;jenkins-hbase9:33013] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,057 DEBUG [RS:1;jenkins-hbase9:41227] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,058 DEBUG [RS:1;jenkins-hbase9:41227] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,058 DEBUG [RS:0;jenkins-hbase9:33013] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,058 DEBUG [RS:0;jenkins-hbase9:33013] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,058 DEBUG [RS:0;jenkins-hbase9:33013] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,058 DEBUG [RS:0;jenkins-hbase9:33013] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,058 DEBUG [RS:0;jenkins-hbase9:33013] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,058 DEBUG [RS:0;jenkins-hbase9:33013] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:50,058 DEBUG [RS:0;jenkins-hbase9:33013] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,058 DEBUG [RS:0;jenkins-hbase9:33013] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,059 DEBUG [RS:0;jenkins-hbase9:33013] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,059 DEBUG [RS:0;jenkins-hbase9:33013] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:50,064 INFO [RS:1;jenkins-hbase9:41227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,064 INFO [RS:1;jenkins-hbase9:41227] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,064 INFO [RS:1;jenkins-hbase9:41227] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,064 INFO [RS:0;jenkins-hbase9:33013] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,064 INFO [RS:0;jenkins-hbase9:33013] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,064 INFO [RS:0;jenkins-hbase9:33013] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,078 INFO [RS:1;jenkins-hbase9:41227] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:50,079 INFO [RS:1;jenkins-hbase9:41227] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41227,1676153029789-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,081 INFO [RS:0;jenkins-hbase9:33013] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:50,081 INFO [RS:0;jenkins-hbase9:33013] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33013,1676153029764-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,090 INFO [RS:1;jenkins-hbase9:41227] regionserver.Replication(203): jenkins-hbase9.apache.org,41227,1676153029789 started 2023-02-11 22:03:50,090 INFO [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,41227,1676153029789, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:41227, sessionid=0x100456a64250002 2023-02-11 22:03:50,090 DEBUG [RS:1;jenkins-hbase9:41227] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:50,090 DEBUG [RS:1;jenkins-hbase9:41227] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:50,090 DEBUG [RS:1;jenkins-hbase9:41227] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41227,1676153029789' 2023-02-11 22:03:50,090 DEBUG [RS:1;jenkins-hbase9:41227] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:50,090 DEBUG [RS:1;jenkins-hbase9:41227] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:50,090 DEBUG [RS:1;jenkins-hbase9:41227] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:50,090 DEBUG [RS:1;jenkins-hbase9:41227] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:50,090 DEBUG [RS:1;jenkins-hbase9:41227] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:50,091 DEBUG [RS:1;jenkins-hbase9:41227] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41227,1676153029789' 2023-02-11 22:03:50,091 DEBUG [RS:1;jenkins-hbase9:41227] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:50,091 DEBUG [RS:1;jenkins-hbase9:41227] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:50,091 INFO [RS:0;jenkins-hbase9:33013] regionserver.Replication(203): jenkins-hbase9.apache.org,33013,1676153029764 started 2023-02-11 22:03:50,091 INFO [RS:0;jenkins-hbase9:33013] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,33013,1676153029764, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:33013, sessionid=0x100456a64250001 2023-02-11 22:03:50,091 DEBUG [RS:0;jenkins-hbase9:33013] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:50,091 DEBUG [RS:0;jenkins-hbase9:33013] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:50,091 DEBUG [RS:1;jenkins-hbase9:41227] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:50,091 DEBUG [RS:0;jenkins-hbase9:33013] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,33013,1676153029764' 2023-02-11 22:03:50,091 DEBUG [RS:0;jenkins-hbase9:33013] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:50,091 INFO [RS:1;jenkins-hbase9:41227] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:50,091 INFO [RS:1;jenkins-hbase9:41227] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:50,091 DEBUG [RS:0;jenkins-hbase9:33013] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:50,092 DEBUG [RS:0;jenkins-hbase9:33013] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:50,092 DEBUG [RS:0;jenkins-hbase9:33013] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:50,092 DEBUG [RS:0;jenkins-hbase9:33013] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:50,092 DEBUG [RS:0;jenkins-hbase9:33013] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,33013,1676153029764' 2023-02-11 22:03:50,092 DEBUG [RS:0;jenkins-hbase9:33013] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:50,092 DEBUG [RS:0;jenkins-hbase9:33013] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:50,092 DEBUG [RS:0;jenkins-hbase9:33013] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:50,092 INFO [RS:0;jenkins-hbase9:33013] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:50,092 INFO [RS:0;jenkins-hbase9:33013] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:50,130 DEBUG [jenkins-hbase9:35753] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 22:03:50,131 DEBUG [jenkins-hbase9:35753] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:50,132 DEBUG [jenkins-hbase9:35753] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:50,132 DEBUG [jenkins-hbase9:35753] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:50,132 DEBUG [jenkins-hbase9:35753] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:50,132 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,41227,1676153029789, state=OPENING 2023-02-11 22:03:50,134 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 22:03:50,134 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:50,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,41227,1676153029789}] 2023-02-11 22:03:50,135 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:50,290 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:50,290 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 22:03:50,291 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40794, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 22:03:50,295 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 22:03:50,295 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:50,296 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41227%2C1676153029789.meta, suffix=.meta, logDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/WALs/jenkins-hbase9.apache.org,41227,1676153029789, archiveDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/oldWALs, maxLogs=32 2023-02-11 22:03:50,309 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46483,DS-1cecffa4-1f44-453b-9808-e537707956f2,DISK] 2023-02-11 22:03:50,309 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46243,DS-fc47acf9-fc61-46ef-9ceb-21bcc7eccbd2,DISK] 2023-02-11 22:03:50,310 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/WALs/jenkins-hbase9.apache.org,41227,1676153029789/jenkins-hbase9.apache.org%2C41227%2C1676153029789.meta.1676153030297.meta 2023-02-11 22:03:50,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46483,DS-1cecffa4-1f44-453b-9808-e537707956f2,DISK], DatanodeInfoWithStorage[127.0.0.1:46243,DS-fc47acf9-fc61-46ef-9ceb-21bcc7eccbd2,DISK]] 2023-02-11 22:03:50,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:50,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 22:03:50,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 22:03:50,311 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 22:03:50,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 22:03:50,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:50,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 22:03:50,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 22:03:50,312 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:50,313 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/info 2023-02-11 22:03:50,313 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/info 2023-02-11 22:03:50,313 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:50,314 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:50,314 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:50,315 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:50,315 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:50,315 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:50,315 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:50,315 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:50,316 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/table 2023-02-11 22:03:50,316 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/table 2023-02-11 22:03:50,316 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:50,316 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:50,317 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740 2023-02-11 22:03:50,318 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740 2023-02-11 22:03:50,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:50,320 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:50,320 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69194408, jitterRate=0.031077027320861816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:50,320 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676153030311Writing region info on filesystem at 1676153030311Initializing all the Stores at 1676153030312 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153030312Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153030312Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153030312Cleaning up temporary data from old regions at 1676153030318 (+6 ms)Cleaning up detritus from prior splits at 1676153030318Running coprocessor post-open hooks at 1676153030320 (+2 ms)Region opened successfully at 1676153030320 2023-02-11 22:03:50,321 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676153030289 2023-02-11 22:03:50,324 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 22:03:50,324 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 22:03:50,325 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,41227,1676153029789, state=OPEN 2023-02-11 22:03:50,327 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 22:03:50,327 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:50,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 22:03:50,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,41227,1676153029789 in 192 msec 2023-02-11 22:03:50,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 22:03:50,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 350 msec 2023-02-11 22:03:50,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 387 msec 2023-02-11 22:03:50,330 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676153029817, completionTime=-1 2023-02-11 22:03:50,330 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 22:03:50,330 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 22:03:50,335 DEBUG [hconnection-0x7a8b6820-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:50,336 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40806, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:50,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 22:03:50,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676153090337 2023-02-11 22:03:50,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676153150337 2023-02-11 22:03:50,338 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-11 22:03:50,346 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35753,1676153029714-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,346 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35753,1676153029714-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,346 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35753,1676153029714-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,346 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:35753, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,346 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:50,346 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 22:03:50,346 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:50,347 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 22:03:50,348 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 22:03:50,349 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:50,349 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:50,350 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692 2023-02-11 22:03:50,351 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692 empty. 2023-02-11 22:03:50,351 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692 2023-02-11 22:03:50,351 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 22:03:50,359 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:50,360 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7e2298eb74ac8989b04769a1657a9692, NAME => 'hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp 2023-02-11 22:03:50,369 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:50,369 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 7e2298eb74ac8989b04769a1657a9692, disabling compactions & flushes 2023-02-11 22:03:50,369 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. 2023-02-11 22:03:50,369 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. 2023-02-11 22:03:50,369 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. after waiting 0 ms 2023-02-11 22:03:50,369 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. 2023-02-11 22:03:50,369 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. 2023-02-11 22:03:50,369 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 7e2298eb74ac8989b04769a1657a9692: Waiting for close lock at 1676153030369Disabling compacts and flushes for region at 1676153030369Disabling writes for close at 1676153030369Writing region close event to WAL at 1676153030369Closed at 1676153030369 2023-02-11 22:03:50,370 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:50,371 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153030371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153030371"}]},"ts":"1676153030371"} 2023-02-11 22:03:50,372 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 22:03:50,373 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:50,373 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153030373"}]},"ts":"1676153030373"} 2023-02-11 22:03:50,374 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 22:03:50,378 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:50,379 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:50,379 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:50,379 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:50,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7e2298eb74ac8989b04769a1657a9692, ASSIGN}] 2023-02-11 22:03:50,381 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7e2298eb74ac8989b04769a1657a9692, ASSIGN 2023-02-11 22:03:50,382 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7e2298eb74ac8989b04769a1657a9692, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41227,1676153029789; forceNewPlan=false, retain=false 2023-02-11 22:03:50,532 INFO [jenkins-hbase9:35753] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 22:03:50,532 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7e2298eb74ac8989b04769a1657a9692, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:50,533 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153030532"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153030532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153030532"}]},"ts":"1676153030532"} 2023-02-11 22:03:50,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7e2298eb74ac8989b04769a1657a9692, server=jenkins-hbase9.apache.org,41227,1676153029789}] 2023-02-11 22:03:50,688 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. 2023-02-11 22:03:50,689 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41227%2C1676153029789, suffix=, logDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/WALs/jenkins-hbase9.apache.org,41227,1676153029789, archiveDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/oldWALs, maxLogs=32 2023-02-11 22:03:50,704 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46243,DS-fc47acf9-fc61-46ef-9ceb-21bcc7eccbd2,DISK] 2023-02-11 22:03:50,704 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46483,DS-1cecffa4-1f44-453b-9808-e537707956f2,DISK] 2023-02-11 22:03:50,705 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/WALs/jenkins-hbase9.apache.org,41227,1676153029789/jenkins-hbase9.apache.org%2C41227%2C1676153029789.1676153030689 2023-02-11 22:03:50,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46243,DS-fc47acf9-fc61-46ef-9ceb-21bcc7eccbd2,DISK], DatanodeInfoWithStorage[127.0.0.1:46483,DS-1cecffa4-1f44-453b-9808-e537707956f2,DISK]] 2023-02-11 22:03:50,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7e2298eb74ac8989b04769a1657a9692, NAME => 'hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:50,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7e2298eb74ac8989b04769a1657a9692 2023-02-11 22:03:50,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:50,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 7e2298eb74ac8989b04769a1657a9692 2023-02-11 22:03:50,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 7e2298eb74ac8989b04769a1657a9692 2023-02-11 22:03:50,708 INFO [StoreOpener-7e2298eb74ac8989b04769a1657a9692-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7e2298eb74ac8989b04769a1657a9692 2023-02-11 22:03:50,709 DEBUG [StoreOpener-7e2298eb74ac8989b04769a1657a9692-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692/info 2023-02-11 22:03:50,710 DEBUG [StoreOpener-7e2298eb74ac8989b04769a1657a9692-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692/info 2023-02-11 22:03:50,710 INFO [StoreOpener-7e2298eb74ac8989b04769a1657a9692-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e2298eb74ac8989b04769a1657a9692 columnFamilyName info 2023-02-11 22:03:50,710 INFO [StoreOpener-7e2298eb74ac8989b04769a1657a9692-1] regionserver.HStore(310): Store=7e2298eb74ac8989b04769a1657a9692/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:50,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692 2023-02-11 22:03:50,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692 2023-02-11 22:03:50,713 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 7e2298eb74ac8989b04769a1657a9692 2023-02-11 22:03:50,714 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:50,714 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 7e2298eb74ac8989b04769a1657a9692; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75222816, jitterRate=0.12090730667114258}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:50,714 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 7e2298eb74ac8989b04769a1657a9692: Running coprocessor pre-open hook at 1676153030707Writing region info on filesystem at 1676153030707Initializing all the Stores at 1676153030708 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153030708Cleaning up temporary data from old regions at 1676153030711 (+3 ms)Cleaning up detritus from prior splits at 1676153030711Running coprocessor post-open hooks at 1676153030714 (+3 ms)Region opened successfully at 1676153030714 2023-02-11 22:03:50,715 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692., pid=6, masterSystemTime=1676153030685 2023-02-11 22:03:50,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. 2023-02-11 22:03:50,717 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. 2023-02-11 22:03:50,717 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7e2298eb74ac8989b04769a1657a9692, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:50,717 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153030717"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153030717"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153030717"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153030717"}]},"ts":"1676153030717"} 2023-02-11 22:03:50,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 22:03:50,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7e2298eb74ac8989b04769a1657a9692, server=jenkins-hbase9.apache.org,41227,1676153029789 in 184 msec 2023-02-11 22:03:50,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 22:03:50,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7e2298eb74ac8989b04769a1657a9692, ASSIGN in 340 msec 2023-02-11 22:03:50,721 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:50,721 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153030721"}]},"ts":"1676153030721"} 2023-02-11 22:03:50,722 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 22:03:50,724 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:50,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 378 msec 2023-02-11 22:03:50,748 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 22:03:50,749 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:50,749 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:50,752 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 22:03:50,759 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:50,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-11 22:03:50,764 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 22:03:50,769 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:50,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-11 22:03:50,779 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 22:03:50,781 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 22:03:50,781 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.956sec 2023-02-11 22:03:50,781 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 22:03:50,781 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 22:03:50,782 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 22:03:50,782 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35753,1676153029714-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 22:03:50,782 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35753,1676153029714-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 22:03:50,783 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 22:03:50,816 DEBUG [Listener at localhost/39979] zookeeper.ReadOnlyZKClient(139): Connect 0x14ce3beb to 127.0.0.1:52653 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:50,818 DEBUG [Listener at localhost/39979] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60089124, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:50,820 DEBUG [hconnection-0xca04696-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:50,821 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59602, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:50,822 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,35753,1676153029714 2023-02-11 22:03:50,822 DEBUG [Listener at localhost/39979] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 22:03:50,824 DEBUG [Listener at localhost/39979] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 22:03:50,826 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52968, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 22:03:50,826 INFO [Listener at localhost/39979] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:50,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:50,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 22:03:50,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 103 connection: 172.31.2.10:52968 deadline: 1676153090826, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:50,827 INFO [Listener at localhost/39979] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-11 22:03:50,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:50,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:50,831 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:50,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-11 22:03:50,831 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:50,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:50,833 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:50,833 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b empty. 2023-02-11 22:03:50,833 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:50,833 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-11 22:03:50,841 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:50,842 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => e7cec744cf528cc959336a7311318d3b, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp 2023-02-11 22:03:50,847 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:50,847 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing e7cec744cf528cc959336a7311318d3b, disabling compactions & flushes 2023-02-11 22:03:50,847 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:50,847 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:50,847 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. after waiting 0 ms 2023-02-11 22:03:50,847 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:50,847 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:50,847 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for e7cec744cf528cc959336a7311318d3b: Waiting for close lock at 1676153030847Disabling compacts and flushes for region at 1676153030847Disabling writes for close at 1676153030847Writing region close event to WAL at 1676153030847Closed at 1676153030847 2023-02-11 22:03:50,849 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:50,849 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676153030849"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153030849"}]},"ts":"1676153030849"} 2023-02-11 22:03:50,851 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 22:03:50,851 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:50,851 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153030851"}]},"ts":"1676153030851"} 2023-02-11 22:03:50,852 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-11 22:03:50,856 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:50,857 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:50,857 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:50,857 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:50,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=e7cec744cf528cc959336a7311318d3b, ASSIGN}] 2023-02-11 22:03:50,859 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=e7cec744cf528cc959336a7311318d3b, ASSIGN 2023-02-11 22:03:50,859 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=e7cec744cf528cc959336a7311318d3b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41227,1676153029789; forceNewPlan=false, retain=false 2023-02-11 22:03:50,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:51,009 INFO [jenkins-hbase9:35753] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 22:03:51,010 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e7cec744cf528cc959336a7311318d3b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,010 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676153031010"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153031010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153031010"}]},"ts":"1676153031010"} 2023-02-11 22:03:51,012 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure e7cec744cf528cc959336a7311318d3b, server=jenkins-hbase9.apache.org,41227,1676153029789}] 2023-02-11 22:03:51,094 INFO [RS:0;jenkins-hbase9:33013] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33013%2C1676153029764, suffix=, logDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/WALs/jenkins-hbase9.apache.org,33013,1676153029764, archiveDir=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/oldWALs, maxLogs=32 2023-02-11 22:03:51,109 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46243,DS-fc47acf9-fc61-46ef-9ceb-21bcc7eccbd2,DISK] 2023-02-11 22:03:51,109 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46483,DS-1cecffa4-1f44-453b-9808-e537707956f2,DISK] 2023-02-11 22:03:51,110 INFO [RS:0;jenkins-hbase9:33013] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/WALs/jenkins-hbase9.apache.org,33013,1676153029764/jenkins-hbase9.apache.org%2C33013%2C1676153029764.1676153031094 2023-02-11 22:03:51,110 DEBUG [RS:0;jenkins-hbase9:33013] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46243,DS-fc47acf9-fc61-46ef-9ceb-21bcc7eccbd2,DISK], DatanodeInfoWithStorage[127.0.0.1:46483,DS-1cecffa4-1f44-453b-9808-e537707956f2,DISK]] 2023-02-11 22:03:51,120 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 22:03:51,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:51,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:51,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e7cec744cf528cc959336a7311318d3b, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:51,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:51,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:51,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:51,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:51,178 INFO [StoreOpener-e7cec744cf528cc959336a7311318d3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:51,180 DEBUG [StoreOpener-e7cec744cf528cc959336a7311318d3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1 2023-02-11 22:03:51,180 DEBUG [StoreOpener-e7cec744cf528cc959336a7311318d3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1 2023-02-11 22:03:51,183 INFO [StoreOpener-e7cec744cf528cc959336a7311318d3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7cec744cf528cc959336a7311318d3b columnFamilyName f1 2023-02-11 22:03:51,184 INFO [StoreOpener-e7cec744cf528cc959336a7311318d3b-1] regionserver.HStore(310): Store=e7cec744cf528cc959336a7311318d3b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:51,184 INFO [StoreOpener-e7cec744cf528cc959336a7311318d3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:51,185 DEBUG [StoreOpener-e7cec744cf528cc959336a7311318d3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2 2023-02-11 22:03:51,186 DEBUG [StoreOpener-e7cec744cf528cc959336a7311318d3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2 2023-02-11 22:03:51,186 INFO [StoreOpener-e7cec744cf528cc959336a7311318d3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7cec744cf528cc959336a7311318d3b columnFamilyName f2 2023-02-11 22:03:51,186 INFO [StoreOpener-e7cec744cf528cc959336a7311318d3b-1] regionserver.HStore(310): Store=e7cec744cf528cc959336a7311318d3b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:51,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:51,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:51,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:51,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:51,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:51,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened e7cec744cf528cc959336a7311318d3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58849038, jitterRate=-0.12308099865913391}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:51,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for e7cec744cf528cc959336a7311318d3b: Running coprocessor pre-open hook at 1676153031176Writing region info on filesystem at 1676153031176Initializing all the Stores at 1676153031176Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153031176Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153031178 (+2 ms)Cleaning up temporary data from old regions at 1676153031188 (+10 ms)Cleaning up detritus from prior splits at 1676153031189 (+1 ms)Running coprocessor post-open hooks at 1676153031195 (+6 ms)Region opened successfully at 1676153031195 2023-02-11 22:03:51,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b., pid=12, masterSystemTime=1676153031164 2023-02-11 22:03:51,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:51,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:51,200 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e7cec744cf528cc959336a7311318d3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,200 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676153031200"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153031200"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153031200"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153031200"}]},"ts":"1676153031200"} 2023-02-11 22:03:51,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-11 22:03:51,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure e7cec744cf528cc959336a7311318d3b, server=jenkins-hbase9.apache.org,41227,1676153029789 in 190 msec 2023-02-11 22:03:51,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 22:03:51,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=e7cec744cf528cc959336a7311318d3b, ASSIGN in 345 msec 2023-02-11 22:03:51,204 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:51,204 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153031204"}]},"ts":"1676153031204"} 2023-02-11 22:03:51,205 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-11 22:03:51,207 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:51,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 378 msec 2023-02-11 22:03:51,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:51,441 INFO [Listener at localhost/39979] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-11 22:03:51,441 DEBUG [Listener at localhost/39979] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-11 22:03:51,442 INFO [Listener at localhost/39979] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:51,444 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-11 22:03:51,444 INFO [Listener at localhost/39979] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:51,444 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-11 22:03:51,444 INFO [Listener at localhost/39979] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 22:03:51,478 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41227] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:51,559 INFO [Listener at localhost/39979] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 22:03:51,559 INFO [Listener at localhost/39979] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 22:03:51,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-11 22:03:51,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676153031560 (current time:1676153031560). 2023-02-11 22:03:51,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 22:03:51,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] zookeeper.ReadOnlyZKClient(139): Connect 0x439dc2b1 to 127.0.0.1:52653 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:51,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b619c99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:51,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:51,565 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59606, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:51,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x439dc2b1 to 127.0.0.1:52653 2023-02-11 22:03:51,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:51,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 22:03:51,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-11 22:03:51,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-11 22:03:51,570 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-11 22:03:51,570 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676153631570 2023-02-11 22:03:51,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-11 22:03:51,571 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:51,572 DEBUG [Listener at localhost/39979] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:51,572 DEBUG [Listener at localhost/39979] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 22:03:51,573 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-11 22:03:51,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-11 22:03:51,574 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-11 22:03:51,574 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-11 22:03:51,575 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676153631575 2023-02-11 22:03:51,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-11 22:03:51,582 INFO [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-11 22:03:51,582 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:51,583 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-11 22:03:51,583 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-11 22:03:51,583 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,583 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-11 22:03:51,584 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:51,584 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:51,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:51,584 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:51,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:51,585 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,585 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-11 22:03:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-11 22:03:51,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-11 22:03:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-11 22:03:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-11 22:03:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-11 22:03:51,585 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-11 22:03:51,586 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-11 22:03:51,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-11 22:03:51,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-11 22:03:51,586 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-11 22:03:51,586 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:51,586 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-11 22:03:51,587 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-11 22:03:51,587 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-11 22:03:51,587 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:51,587 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33013,1676153029764' joining acquired barrier for procedure (foo) in zk 2023-02-11 22:03:51,587 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-11 22:03:51,587 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-11 22:03:51,587 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41227,1676153029789' joining acquired barrier for procedure (foo) in zk 2023-02-11 22:03:51,589 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,589 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,589 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:51,589 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,589 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:51,589 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,589 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 22:03:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:51,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41227,1676153029789' joining acquired barrier for procedure 'foo' on coordinator 2023-02-11 22:03:51,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72e704ee[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:51,591 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-11 22:03:51,591 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,592 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,592 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,592 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-11 22:03:51,592 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-11 22:03:51,592 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,592 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:51,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,592 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase9.apache.org,33013,1676153029764' in zk 2023-02-11 22:03:51,592 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-11 22:03:51,592 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-11 22:03:51,592 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 22:03:51,592 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:51,592 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. started... 2023-02-11 22:03:51,593 INFO [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e7cec744cf528cc959336a7311318d3b 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-11 22:03:51,594 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-11 22:03:51,594 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:51,594 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-11 22:03:51,605 INFO [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/.tmp/f1/02ab31de11904c529f3e00b6368b0995 2023-02-11 22:03:51,621 INFO [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/.tmp/f2/1f89300d30dd494aafe115e88554a292 2023-02-11 22:03:51,625 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/.tmp/f1/02ab31de11904c529f3e00b6368b0995 as hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1/02ab31de11904c529f3e00b6368b0995 2023-02-11 22:03:51,628 INFO [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1/02ab31de11904c529f3e00b6368b0995, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 22:03:51,629 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/.tmp/f2/1f89300d30dd494aafe115e88554a292 as hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2/1f89300d30dd494aafe115e88554a292 2023-02-11 22:03:51,632 INFO [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2/1f89300d30dd494aafe115e88554a292, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 22:03:51,633 INFO [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for e7cec744cf528cc959336a7311318d3b in 41ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:51,633 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-11 22:03:51,634 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e7cec744cf528cc959336a7311318d3b: 2023-02-11 22:03:51,634 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.' region-info for snapshot=foo 2023-02-11 22:03:51,634 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:51,634 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1/02ab31de11904c529f3e00b6368b0995] hfiles 2023-02-11 22:03:51,634 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1/02ab31de11904c529f3e00b6368b0995 for snapshot=foo 2023-02-11 22:03:51,634 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2/1f89300d30dd494aafe115e88554a292] hfiles 2023-02-11 22:03:51,634 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2/1f89300d30dd494aafe115e88554a292 for snapshot=foo 2023-02-11 22:03:51,643 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. completed. 2023-02-11 22:03:51,643 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:51,643 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-11 22:03:51,644 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-11 22:03:51,644 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,644 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-11 22:03:51,644 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase9.apache.org,41227,1676153029789' in zk 2023-02-11 22:03:51,645 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-11 22:03:51,645 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,645 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:51,645 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-11 22:03:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 22:03:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 22:03:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase9.apache.org,41227,1676153029789': 2023-02-11 22:03:51,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41227,1676153029789' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-11 22:03:51,648 INFO [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-11 22:03:51,648 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:51,648 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:51,648 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-11 22:03:51,648 INFO [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 22:03:51,650 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,650 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,650 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,650 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,650 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:51,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:51,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:51,651 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 22:03:51,651 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 22:03:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,652 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:51,653 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 22:03:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,662 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,662 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-11 22:03:51,662 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:51,662 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:51,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:51,662 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:51,662 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:51,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:51,662 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-11 22:03:51,662 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:51,662 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:51,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:51,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:51,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-11 22:03:51,662 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-11 22:03:51,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:51,662 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:51,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:51,663 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,663 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:51,663 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 22:03:51,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:51,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:51,663 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 22:03:51,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.hbase-snapshot/.tmp/foo 2023-02-11 22:03:51,672 DEBUG [Listener at localhost/39979] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:51,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-11 22:03:51,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:51,675 DEBUG [Listener at localhost/39979] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 22:03:51,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.hbase-snapshot/.tmp/foo to hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.hbase-snapshot/foo 2023-02-11 22:03:51,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-11 22:03:51,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.hbase-snapshot/.tmp/foo 2023-02-11 22:03:51,699 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.hbase-snapshot/.tmp/foo 2023-02-11 22:03:51,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676153031571Consolidate snapshot: foo at 1676153031662 (+91 ms)Loading Region manifests for foo at 1676153031662Writing data manifest for foo at 1676153031665 (+3 ms)Verifying snapshot: foo at 1676153031679 (+14 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676153031699 (+20 ms) 2023-02-11 22:03:51,702 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-11 22:03:51,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 130 msec 2023-02-11 22:03:51,875 DEBUG [Listener at localhost/39979] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:51,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-11 22:03:51,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 22:03:51,877 INFO [Listener at localhost/39979] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 22:03:51,880 INFO [Listener at localhost/39979] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 22:03:51,885 INFO [Listener at localhost/39979] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 22:03:51,918 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41227] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:52,003 INFO [Listener at localhost/39979] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 22:03:52,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-11 22:03:52,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,010 INFO [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-11 22:03:52,010 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:52,012 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-11 22:03:52,012 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-11 22:03:52,012 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,012 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,013 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:52,013 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:52,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:52,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:52,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:52,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:52,013 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,014 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,014 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,014 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,014 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,015 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-11 22:03:52,015 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:52,015 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-11 22:03:52,016 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-11 22:03:52,016 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:52,016 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 22:03:52,016 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-11 22:03:52,016 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-11 22:03:52,016 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33013,1676153029764' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-11 22:03:52,016 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:52,016 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. started... 2023-02-11 22:03:52,016 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 22:03:52,017 INFO [rs(jenkins-hbase9.apache.org,41227,1676153029789)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e7cec744cf528cc959336a7311318d3b 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-11 22:03:52,018 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,018 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,018 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:52,031 INFO [rs(jenkins-hbase9.apache.org,41227,1676153029789)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/.tmp/f1/4fb03f468f6d4111897865a8eb43102c 2023-02-11 22:03:52,048 INFO [rs(jenkins-hbase9.apache.org,41227,1676153029789)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/.tmp/f2/29fa0d92dd794a3297bceef24cfa7ead 2023-02-11 22:03:52,052 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/.tmp/f1/4fb03f468f6d4111897865a8eb43102c as hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1/4fb03f468f6d4111897865a8eb43102c 2023-02-11 22:03:52,056 INFO [rs(jenkins-hbase9.apache.org,41227,1676153029789)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1/4fb03f468f6d4111897865a8eb43102c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 22:03:52,056 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/.tmp/f2/29fa0d92dd794a3297bceef24cfa7ead as hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2/29fa0d92dd794a3297bceef24cfa7ead 2023-02-11 22:03:52,060 INFO [rs(jenkins-hbase9.apache.org,41227,1676153029789)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2/29fa0d92dd794a3297bceef24cfa7ead, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 22:03:52,061 INFO [rs(jenkins-hbase9.apache.org,41227,1676153029789)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for e7cec744cf528cc959336a7311318d3b in 44ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:52,062 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e7cec744cf528cc959336a7311318d3b: 2023-02-11 22:03:52,062 DEBUG [rs(jenkins-hbase9.apache.org,41227,1676153029789)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:52,062 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 22:03:52,062 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 22:03:52,062 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,062 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-11 22:03:52,062 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41227,1676153029789' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-11 22:03:52,065 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,065 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:52,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:52,066 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,066 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:52,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:52,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:52,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:52,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:52,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41227,1676153029789' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-11 22:03:52,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76d89e6a[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:52,067 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-11 22:03:52,067 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,068 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,068 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,069 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-11 22:03:52,069 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-11 22:03:52,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,069 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase9.apache.org,33013,1676153029764' in zk 2023-02-11 22:03:52,069 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,069 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:52,069 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-11 22:03:52,069 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-11 22:03:52,069 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase9.apache.org,41227,1676153029789' in zk 2023-02-11 22:03:52,070 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-11 22:03:52,070 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:52,070 DEBUG [member: 'jenkins-hbase9.apache.org,33013,1676153029764' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-11 22:03:52,071 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-11 22:03:52,071 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:52,071 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,071 DEBUG [member: 'jenkins-hbase9.apache.org,41227,1676153029789' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-11 22:03:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:52,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:52,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:52,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:52,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase9.apache.org,41227,1676153029789': 2023-02-11 22:03:52,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41227,1676153029789' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-11 22:03:52,074 INFO [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-11 22:03:52,074 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:52,074 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:52,074 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,074 INFO [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 22:03:52,076 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,076 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,076 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:52,076 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,076 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:52,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:52,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:52,077 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,077 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:52,078 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,079 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,081 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:52,081 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,081 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:52,081 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,081 DEBUG [(jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:52,081 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:52,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:52,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:52,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks because node does not exist (not an error) 2023-02-11 22:03:52,081 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:52,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:52,082 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-11 22:03:52,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 22:03:52,081 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:52,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:52,082 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:52,082 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,082 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:52,082 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,082 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,082 DEBUG [Listener at localhost/39979] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:52,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:52,082 DEBUG [Listener at localhost/39979] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 22:03:52,183 DEBUG [Listener at localhost/39979] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 22:03:52,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 22:03:52,188 INFO [Listener at localhost/39979] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676153031560 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:52,188 DEBUG [Listener at localhost/39979] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38107/user/jenkins/test-data/5e021fe0-07ed-47b5-a621-9fc24578dafd/foo/eed0d34b-4043-4009-ae5f-998b026b38c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,189 INFO [Listener at localhost/39979] snapshot.RestoreSnapshotHelper(239): region to add: e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:52,189 INFO [Listener at localhost/39979] snapshot.RestoreSnapshotHelper(585): clone region=e7cec744cf528cc959336a7311318d3b as e7cec744cf528cc959336a7311318d3b in snapshot foo 2023-02-11 22:03:52,189 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e7cec744cf528cc959336a7311318d3b, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38107/user/jenkins/test-data/5e021fe0-07ed-47b5-a621-9fc24578dafd/foo/eed0d34b-4043-4009-ae5f-998b026b38c6 2023-02-11 22:03:52,196 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:52,196 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 02ab31de11904c529f3e00b6368b0995 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,198 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1f89300d30dd494aafe115e88554a292 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,200 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e7cec744cf528cc959336a7311318d3b, disabling compactions & flushes 2023-02-11 22:03:52,200 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:52,200 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:52,200 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. after waiting 0 ms 2023-02-11 22:03:52,200 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:52,200 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:52,200 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e7cec744cf528cc959336a7311318d3b: Waiting for close lock at 1676153032200Disabling compacts and flushes for region at 1676153032200Disabling writes for close at 1676153032200Writing region close event to WAL at 1676153032200Closed at 1676153032200 2023-02-11 22:03:52,202 INFO [Listener at localhost/39979] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676153031560 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:52,202 DEBUG [Listener at localhost/39979] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38107/user/jenkins/test-data/5e021fe0-07ed-47b5-a621-9fc24578dafd/foo/eed0d34b-4043-4009-ae5f-998b026b38c6 2023-02-11 22:03:52,202 DEBUG [Listener at localhost/39979] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38107/user/jenkins/test-data/5e021fe0-07ed-47b5-a621-9fc24578dafd/foo/eed0d34b-4043-4009-ae5f-998b026b38c6 2023-02-11 22:03:52,202 DEBUG [Listener at localhost/39979] util.CommonFSUtils(699): |-data/ 2023-02-11 22:03:52,202 DEBUG [Listener at localhost/39979] util.CommonFSUtils(699): |----default/ 2023-02-11 22:03:52,203 DEBUG [Listener at localhost/39979] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-11 22:03:52,203 DEBUG [Listener at localhost/39979] util.CommonFSUtils(699): |----------e7cec744cf528cc959336a7311318d3b/ 2023-02-11 22:03:52,203 DEBUG [Listener at localhost/39979] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:52,203 DEBUG [Listener at localhost/39979] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:52,204 DEBUG [Listener at localhost/39979] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=e7cec744cf528cc959336a7311318d3b-02ab31de11904c529f3e00b6368b0995 2023-02-11 22:03:52,204 DEBUG [Listener at localhost/39979] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:52,204 DEBUG [Listener at localhost/39979] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=e7cec744cf528cc959336a7311318d3b-1f89300d30dd494aafe115e88554a292 hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1/02ab31de11904c529f3e00b6368b0995 hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1/4fb03f468f6d4111897865a8eb43102c hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2/1f89300d30dd494aafe115e88554a292 hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2/29fa0d92dd794a3297bceef24cfa7ead 2023-02-11 22:03:52,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "foo" 2023-02-11 22:03:52,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-11 22:03:52,212 INFO [Listener at localhost/39979] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 22:03:52,216 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153032216"}]},"ts":"1676153032216"} 2023-02-11 22:03:52,217 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-11 22:03:52,219 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-11 22:03:52,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=e7cec744cf528cc959336a7311318d3b, UNASSIGN}] 2023-02-11 22:03:52,221 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=e7cec744cf528cc959336a7311318d3b, UNASSIGN 2023-02-11 22:03:52,222 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e7cec744cf528cc959336a7311318d3b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,222 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676153032222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153032222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153032222"}]},"ts":"1676153032222"} 2023-02-11 22:03:52,223 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure e7cec744cf528cc959336a7311318d3b, server=jenkins-hbase9.apache.org,41227,1676153029789}] 2023-02-11 22:03:52,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 22:03:52,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:52,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing e7cec744cf528cc959336a7311318d3b, disabling compactions & flushes 2023-02-11 22:03:52,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:52,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:52,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. after waiting 0 ms 2023-02-11 22:03:52,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:52,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:52,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b. 2023-02-11 22:03:52,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for e7cec744cf528cc959336a7311318d3b: Waiting for close lock at 1676153032375Running coprocessor pre-close hooks at 1676153032375Disabling compacts and flushes for region at 1676153032375Disabling writes for close at 1676153032375Writing region close event to WAL at 1676153032376 (+1 ms)Running coprocessor post-close hooks at 1676153032379 (+3 ms)Closed at 1676153032380 (+1 ms) 2023-02-11 22:03:52,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:52,382 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e7cec744cf528cc959336a7311318d3b, regionState=CLOSED 2023-02-11 22:03:52,382 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676153032382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153032382"}]},"ts":"1676153032382"} 2023-02-11 22:03:52,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-11 22:03:52,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure e7cec744cf528cc959336a7311318d3b, server=jenkins-hbase9.apache.org,41227,1676153029789 in 160 msec 2023-02-11 22:03:52,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 22:03:52,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=e7cec744cf528cc959336a7311318d3b, UNASSIGN in 165 msec 2023-02-11 22:03:52,386 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153032386"}]},"ts":"1676153032386"} 2023-02-11 22:03:52,387 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-11 22:03:52,388 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-11 22:03:52,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 176 msec 2023-02-11 22:03:52,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 22:03:52,519 INFO [Listener at localhost/39979] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-11 22:03:52,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,522 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,523 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 22:03:52,526 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:52,528 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1, FileablePath, hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2, FileablePath, hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/recovered.edits] 2023-02-11 22:03:52,532 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1/02ab31de11904c529f3e00b6368b0995 to hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1/02ab31de11904c529f3e00b6368b0995 2023-02-11 22:03:52,533 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1/4fb03f468f6d4111897865a8eb43102c to hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f1/4fb03f468f6d4111897865a8eb43102c 2023-02-11 22:03:52,535 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2/1f89300d30dd494aafe115e88554a292 to hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2/1f89300d30dd494aafe115e88554a292 2023-02-11 22:03:52,536 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2/29fa0d92dd794a3297bceef24cfa7ead to hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/f2/29fa0d92dd794a3297bceef24cfa7ead 2023-02-11 22:03:52,539 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/recovered.edits/12.seqid to hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b/recovered.edits/12.seqid 2023-02-11 22:03:52,539 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/e7cec744cf528cc959336a7311318d3b 2023-02-11 22:03:52,540 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-11 22:03:52,541 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,543 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-11 22:03:52,544 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-11 22:03:52,551 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,551 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-11 22:03:52,551 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153032551"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:52,553 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 22:03:52,553 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e7cec744cf528cc959336a7311318d3b, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676153030829.e7cec744cf528cc959336a7311318d3b.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 22:03:52,553 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-11 22:03:52,553 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676153032553"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:52,554 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-11 22:03:52,556 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 22:03:52,557 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 37 msec 2023-02-11 22:03:52,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 22:03:52,625 INFO [Listener at localhost/39979] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-11 22:03:52,626 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 22:03:52,626 INFO [Listener at localhost/39979] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 22:03:52,626 DEBUG [Listener at localhost/39979] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14ce3beb to 127.0.0.1:52653 2023-02-11 22:03:52,626 DEBUG [Listener at localhost/39979] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:52,626 DEBUG [Listener at localhost/39979] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 22:03:52,626 DEBUG [Listener at localhost/39979] util.JVMClusterUtil(257): Found active master hash=2112739516, stopped=false 2023-02-11 22:03:52,626 INFO [Listener at localhost/39979] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,35753,1676153029714 2023-02-11 22:03:52,628 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:52,628 INFO [Listener at localhost/39979] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 22:03:52,628 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:52,628 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:52,629 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:52,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:52,630 DEBUG [Listener at localhost/39979] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bb3cbca to 127.0.0.1:52653 2023-02-11 22:03:52,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:52,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:52,631 DEBUG [Listener at localhost/39979] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:52,631 INFO [Listener at localhost/39979] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,33013,1676153029764' ***** 2023-02-11 22:03:52,631 INFO [Listener at localhost/39979] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:52,631 INFO [Listener at localhost/39979] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,41227,1676153029789' ***** 2023-02-11 22:03:52,631 INFO [Listener at localhost/39979] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:52,631 INFO [RS:0;jenkins-hbase9:33013] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:52,632 INFO [RS:0;jenkins-hbase9:33013] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:52,632 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:52,632 INFO [RS:1;jenkins-hbase9:41227] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:52,632 INFO [RS:0;jenkins-hbase9:33013] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:52,633 INFO [RS:0;jenkins-hbase9:33013] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:52,633 DEBUG [RS:0;jenkins-hbase9:33013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b50e8ad to 127.0.0.1:52653 2023-02-11 22:03:52,633 DEBUG [RS:0;jenkins-hbase9:33013] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:52,633 INFO [RS:0;jenkins-hbase9:33013] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,33013,1676153029764; all regions closed. 2023-02-11 22:03:52,633 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:52,633 INFO [RS:1;jenkins-hbase9:41227] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:52,634 INFO [RS:1;jenkins-hbase9:41227] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:52,634 INFO [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(3304): Received CLOSE for 7e2298eb74ac8989b04769a1657a9692 2023-02-11 22:03:52,634 INFO [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,634 DEBUG [RS:1;jenkins-hbase9:41227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f372240 to 127.0.0.1:52653 2023-02-11 22:03:52,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 7e2298eb74ac8989b04769a1657a9692, disabling compactions & flushes 2023-02-11 22:03:52,634 DEBUG [RS:1;jenkins-hbase9:41227] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:52,634 INFO [RS:1;jenkins-hbase9:41227] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:52,634 INFO [RS:1;jenkins-hbase9:41227] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:52,634 INFO [RS:1;jenkins-hbase9:41227] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:52,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. 2023-02-11 22:03:52,634 INFO [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 22:03:52,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. 2023-02-11 22:03:52,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. after waiting 0 ms 2023-02-11 22:03:52,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. 2023-02-11 22:03:52,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 7e2298eb74ac8989b04769a1657a9692 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 22:03:52,635 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:52,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:52,635 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:52,635 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:52,635 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:52,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-11 22:03:52,635 INFO [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-11 22:03:52,635 DEBUG [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(1479): Online Regions={7e2298eb74ac8989b04769a1657a9692=hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692., 1588230740=hbase:meta,,1.1588230740} 2023-02-11 22:03:52,636 DEBUG [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(1505): Waiting on 1588230740, 7e2298eb74ac8989b04769a1657a9692 2023-02-11 22:03:52,637 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/WALs/jenkins-hbase9.apache.org,33013,1676153029764/jenkins-hbase9.apache.org%2C33013%2C1676153029764.1676153031094 not finished, retry = 0 2023-02-11 22:03:52,650 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/.tmp/info/7285f800660142a081daac9513069bda 2023-02-11 22:03:52,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692/.tmp/info/082350a683d04d2eadceeb337ecccd95 2023-02-11 22:03:52,654 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7285f800660142a081daac9513069bda 2023-02-11 22:03:52,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692/.tmp/info/082350a683d04d2eadceeb337ecccd95 as hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692/info/082350a683d04d2eadceeb337ecccd95 2023-02-11 22:03:52,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692/info/082350a683d04d2eadceeb337ecccd95, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 22:03:52,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7e2298eb74ac8989b04769a1657a9692 in 25ms, sequenceid=6, compaction requested=false 2023-02-11 22:03:52,666 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:52,669 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:52,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/namespace/7e2298eb74ac8989b04769a1657a9692/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 22:03:52,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. 2023-02-11 22:03:52,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 7e2298eb74ac8989b04769a1657a9692: Waiting for close lock at 1676153032634Running coprocessor pre-close hooks at 1676153032634Disabling compacts and flushes for region at 1676153032634Disabling writes for close at 1676153032635 (+1 ms)Obtaining lock to block concurrent updates at 1676153032635Preparing flush snapshotting stores in 7e2298eb74ac8989b04769a1657a9692 at 1676153032635Finished memstore snapshotting hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676153032635Flushing stores of hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. at 1676153032637 (+2 ms)Flushing 7e2298eb74ac8989b04769a1657a9692/info: creating writer at 1676153032637Flushing 7e2298eb74ac8989b04769a1657a9692/info: appending metadata at 1676153032639 (+2 ms)Flushing 7e2298eb74ac8989b04769a1657a9692/info: closing flushed file at 1676153032639Flushing 7e2298eb74ac8989b04769a1657a9692/info: reopening flushed file at 1676153032655 (+16 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7e2298eb74ac8989b04769a1657a9692 in 25ms, sequenceid=6, compaction requested=false at 1676153032660 (+5 ms)Writing region close event to WAL at 1676153032668 (+8 ms)Running coprocessor post-close hooks at 1676153032676 (+8 ms)Closed at 1676153032678 (+2 ms) 2023-02-11 22:03:52,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676153030346.7e2298eb74ac8989b04769a1657a9692. 2023-02-11 22:03:52,678 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/.tmp/rep_barrier/6488cfc0ef5c4e3db9372573d1c3e017 2023-02-11 22:03:52,682 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6488cfc0ef5c4e3db9372573d1c3e017 2023-02-11 22:03:52,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/.tmp/table/020bb793825c49f2b07cd57b83e2e292 2023-02-11 22:03:52,696 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 020bb793825c49f2b07cd57b83e2e292 2023-02-11 22:03:52,697 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/.tmp/info/7285f800660142a081daac9513069bda as hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/info/7285f800660142a081daac9513069bda 2023-02-11 22:03:52,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7285f800660142a081daac9513069bda 2023-02-11 22:03:52,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/info/7285f800660142a081daac9513069bda, entries=12, sequenceid=21, filesize=6.3 K 2023-02-11 22:03:52,702 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/.tmp/rep_barrier/6488cfc0ef5c4e3db9372573d1c3e017 as hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/rep_barrier/6488cfc0ef5c4e3db9372573d1c3e017 2023-02-11 22:03:52,706 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6488cfc0ef5c4e3db9372573d1c3e017 2023-02-11 22:03:52,706 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/rep_barrier/6488cfc0ef5c4e3db9372573d1c3e017, entries=1, sequenceid=21, filesize=5.1 K 2023-02-11 22:03:52,706 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/.tmp/table/020bb793825c49f2b07cd57b83e2e292 as hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/table/020bb793825c49f2b07cd57b83e2e292 2023-02-11 22:03:52,710 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 020bb793825c49f2b07cd57b83e2e292 2023-02-11 22:03:52,710 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/table/020bb793825c49f2b07cd57b83e2e292, entries=4, sequenceid=21, filesize=5.1 K 2023-02-11 22:03:52,710 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 75ms, sequenceid=21, compaction requested=false 2023-02-11 22:03:52,714 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-11 22:03:52,715 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 22:03:52,716 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:52,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153032635Running coprocessor pre-close hooks at 1676153032635Disabling compacts and flushes for region at 1676153032635Disabling writes for close at 1676153032635Obtaining lock to block concurrent updates at 1676153032635Preparing flush snapshotting stores in 1588230740 at 1676153032635Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676153032635Flushing stores of hbase:meta,,1.1588230740 at 1676153032637 (+2 ms)Flushing 1588230740/info: creating writer at 1676153032637Flushing 1588230740/info: appending metadata at 1676153032639 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676153032639Flushing 1588230740/rep_barrier: creating writer at 1676153032654 (+15 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676153032656 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676153032656Flushing 1588230740/table: creating writer at 1676153032684 (+28 ms)Flushing 1588230740/table: appending metadata at 1676153032687 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676153032688 (+1 ms)Flushing 1588230740/info: reopening flushed file at 1676153032697 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676153032702 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676153032707 (+5 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 75ms, sequenceid=21, compaction requested=false at 1676153032710 (+3 ms)Writing region close event to WAL at 1676153032712 (+2 ms)Running coprocessor post-close hooks at 1676153032714 (+2 ms)Closed at 1676153032716 (+2 ms) 2023-02-11 22:03:52,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:52,740 DEBUG [RS:0;jenkins-hbase9:33013] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/oldWALs 2023-02-11 22:03:52,740 INFO [RS:0;jenkins-hbase9:33013] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C33013%2C1676153029764:(num 1676153031094) 2023-02-11 22:03:52,740 DEBUG [RS:0;jenkins-hbase9:33013] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:52,740 INFO [RS:0;jenkins-hbase9:33013] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:52,740 INFO [RS:0;jenkins-hbase9:33013] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:52,741 INFO [RS:0;jenkins-hbase9:33013] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:52,741 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:52,741 INFO [RS:0;jenkins-hbase9:33013] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:52,741 INFO [RS:0;jenkins-hbase9:33013] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:52,742 INFO [RS:0;jenkins-hbase9:33013] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:33013 2023-02-11 22:03:52,744 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:52,744 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:52,744 ERROR [Listener at localhost/39979-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6385fb9d rejected from java.util.concurrent.ThreadPoolExecutor@67ba6335[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:52,744 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33013,1676153029764 2023-02-11 22:03:52,744 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:52,744 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:52,744 ERROR [Listener at localhost/39979-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5fc5c594 rejected from java.util.concurrent.ThreadPoolExecutor@67ba6335[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:52,744 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,33013,1676153029764] 2023-02-11 22:03:52,744 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,33013,1676153029764; numProcessing=1 2023-02-11 22:03:52,747 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,33013,1676153029764 already deleted, retry=false 2023-02-11 22:03:52,747 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,33013,1676153029764 expired; onlineServers=1 2023-02-11 22:03:52,836 INFO [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,41227,1676153029789; all regions closed. 2023-02-11 22:03:52,839 DEBUG [RS:1;jenkins-hbase9:41227] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/oldWALs 2023-02-11 22:03:52,840 INFO [RS:1;jenkins-hbase9:41227] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41227%2C1676153029789.meta:.meta(num 1676153030297) 2023-02-11 22:03:52,842 DEBUG [RS:1;jenkins-hbase9:41227] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/oldWALs 2023-02-11 22:03:52,843 INFO [RS:1;jenkins-hbase9:41227] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41227%2C1676153029789:(num 1676153030689) 2023-02-11 22:03:52,843 DEBUG [RS:1;jenkins-hbase9:41227] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:52,843 INFO [RS:1;jenkins-hbase9:41227] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:52,843 INFO [RS:1;jenkins-hbase9:41227] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:52,843 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:52,844 INFO [RS:1;jenkins-hbase9:41227] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41227 2023-02-11 22:03:52,845 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41227,1676153029789 2023-02-11 22:03:52,845 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:52,846 ERROR [Listener at localhost/39979-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e38f830 rejected from java.util.concurrent.ThreadPoolExecutor@7a07632f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:52,846 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,41227,1676153029789] 2023-02-11 22:03:52,847 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,41227,1676153029789; numProcessing=2 2023-02-11 22:03:52,847 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,41227,1676153029789 already deleted, retry=false 2023-02-11 22:03:52,848 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,41227,1676153029789 expired; onlineServers=0 2023-02-11 22:03:52,848 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,35753,1676153029714' ***** 2023-02-11 22:03:52,848 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 22:03:52,848 DEBUG [M:0;jenkins-hbase9:35753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79d243d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:52,848 INFO [M:0;jenkins-hbase9:35753] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,35753,1676153029714 2023-02-11 22:03:52,848 INFO [M:0;jenkins-hbase9:35753] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,35753,1676153029714; all regions closed. 2023-02-11 22:03:52,848 DEBUG [M:0;jenkins-hbase9:35753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:52,848 DEBUG [M:0;jenkins-hbase9:35753] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 22:03:52,849 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 22:03:52,849 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153029951] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153029951,5,FailOnTimeoutGroup] 2023-02-11 22:03:52,849 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153029951] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153029951,5,FailOnTimeoutGroup] 2023-02-11 22:03:52,849 DEBUG [M:0;jenkins-hbase9:35753] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 22:03:52,850 INFO [M:0;jenkins-hbase9:35753] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 22:03:52,850 INFO [M:0;jenkins-hbase9:35753] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 22:03:52,850 INFO [M:0;jenkins-hbase9:35753] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-11 22:03:52,850 DEBUG [M:0;jenkins-hbase9:35753] master.HMaster(1502): Stopping service threads 2023-02-11 22:03:52,850 INFO [M:0;jenkins-hbase9:35753] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 22:03:52,851 ERROR [M:0;jenkins-hbase9:35753] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 22:03:52,851 INFO [M:0;jenkins-hbase9:35753] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 22:03:52,851 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 22:03:52,852 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:52,852 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:52,852 DEBUG [M:0;jenkins-hbase9:35753] zookeeper.ZKUtil(398): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 22:03:52,852 WARN [M:0;jenkins-hbase9:35753] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 22:03:52,852 INFO [M:0;jenkins-hbase9:35753] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 22:03:52,852 INFO [M:0;jenkins-hbase9:35753] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 22:03:52,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:52,852 DEBUG [M:0;jenkins-hbase9:35753] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:52,852 INFO [M:0;jenkins-hbase9:35753] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:52,852 DEBUG [M:0;jenkins-hbase9:35753] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:52,852 DEBUG [M:0;jenkins-hbase9:35753] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:52,852 DEBUG [M:0;jenkins-hbase9:35753] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:52,853 INFO [M:0;jenkins-hbase9:35753] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.64 KB heapSize=67.59 KB 2023-02-11 22:03:52,877 INFO [M:0;jenkins-hbase9:35753] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.64 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/010d3ea96eed4f249ecf8808d4edc641 2023-02-11 22:03:52,881 DEBUG [M:0;jenkins-hbase9:35753] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/010d3ea96eed4f249ecf8808d4edc641 as hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/010d3ea96eed4f249ecf8808d4edc641 2023-02-11 22:03:52,884 INFO [M:0;jenkins-hbase9:35753] regionserver.HStore(1080): Added hdfs://localhost:38107/user/jenkins/test-data/85a19efd-7fc2-17d4-50c0-f0467b5e9c4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/010d3ea96eed4f249ecf8808d4edc641, entries=17, sequenceid=132, filesize=8.7 K 2023-02-11 22:03:52,884 INFO [M:0;jenkins-hbase9:35753] regionserver.HRegion(2947): Finished flush of dataSize ~56.64 KB/57997, heapSize ~67.58 KB/69200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=132, compaction requested=false 2023-02-11 22:03:52,885 INFO [M:0;jenkins-hbase9:35753] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:52,885 DEBUG [M:0;jenkins-hbase9:35753] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153032852Disabling compacts and flushes for region at 1676153032852Disabling writes for close at 1676153032852Obtaining lock to block concurrent updates at 1676153032853 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676153032853Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57997, getHeapSize=69200, getOffHeapSize=0, getCellsCount=145 at 1676153032853Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676153032853Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676153032854 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676153032855 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676153032855Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676153032881 (+26 ms)Finished flush of dataSize ~56.64 KB/57997, heapSize ~67.58 KB/69200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=132, compaction requested=false at 1676153032884 (+3 ms)Writing region close event to WAL at 1676153032885 (+1 ms)Closed at 1676153032885 2023-02-11 22:03:52,887 INFO [M:0;jenkins-hbase9:35753] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 22:03:52,887 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:52,888 INFO [M:0;jenkins-hbase9:35753] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35753 2023-02-11 22:03:52,889 DEBUG [M:0;jenkins-hbase9:35753] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,35753,1676153029714 already deleted, retry=false 2023-02-11 22:03:53,032 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:53,032 INFO [M:0;jenkins-hbase9:35753] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,35753,1676153029714; zookeeper connection closed. 2023-02-11 22:03:53,032 ERROR [Listener at localhost/39979-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5496fb4a rejected from java.util.concurrent.ThreadPoolExecutor@50a97500[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:53,033 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): master:35753-0x100456a64250000, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:53,033 ERROR [Listener at localhost/39979-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@475bcf2a rejected from java.util.concurrent.ThreadPoolExecutor@50a97500[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:53,132 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:53,132 INFO [RS:1;jenkins-hbase9:41227] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,41227,1676153029789; zookeeper connection closed. 2023-02-11 22:03:53,132 ERROR [Listener at localhost/39979-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3730a844 rejected from java.util.concurrent.ThreadPoolExecutor@7a07632f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:53,133 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:41227-0x100456a64250002, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:53,133 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@488334ef] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@488334ef 2023-02-11 22:03:53,133 ERROR [Listener at localhost/39979-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4f2f2b00 rejected from java.util.concurrent.ThreadPoolExecutor@7a07632f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:53,233 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:53,233 INFO [RS:0;jenkins-hbase9:33013] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,33013,1676153029764; zookeeper connection closed. 2023-02-11 22:03:53,233 ERROR [Listener at localhost/39979-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27c7fe76 rejected from java.util.concurrent.ThreadPoolExecutor@67ba6335[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:53,233 DEBUG [Listener at localhost/39979-EventThread] zookeeper.ZKWatcher(600): regionserver:33013-0x100456a64250001, quorum=127.0.0.1:52653, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:53,233 ERROR [Listener at localhost/39979-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@338f8a4a rejected from java.util.concurrent.ThreadPoolExecutor@67ba6335[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:53,233 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@24a47784] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@24a47784 2023-02-11 22:03:53,233 INFO [Listener at localhost/39979] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 22:03:53,233 WARN [Listener at localhost/39979] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:53,237 INFO [Listener at localhost/39979] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:53,341 WARN [BP-780540192-172.31.2.10-1676153029102 heartbeating to localhost/127.0.0.1:38107] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:53,341 WARN [BP-780540192-172.31.2.10-1676153029102 heartbeating to localhost/127.0.0.1:38107] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-780540192-172.31.2.10-1676153029102 (Datanode Uuid 84172317-9047-4461-81f3-e0f7ebe2c81b) service to localhost/127.0.0.1:38107 2023-02-11 22:03:53,342 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/cluster_671774f5-443c-f981-5428-0cb7467049e2/dfs/data/data3/current/BP-780540192-172.31.2.10-1676153029102] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:53,342 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/cluster_671774f5-443c-f981-5428-0cb7467049e2/dfs/data/data4/current/BP-780540192-172.31.2.10-1676153029102] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:53,343 WARN [Listener at localhost/39979] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:53,348 INFO [Listener at localhost/39979] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:53,453 WARN [BP-780540192-172.31.2.10-1676153029102 heartbeating to localhost/127.0.0.1:38107] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:53,453 WARN [BP-780540192-172.31.2.10-1676153029102 heartbeating to localhost/127.0.0.1:38107] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-780540192-172.31.2.10-1676153029102 (Datanode Uuid 0326391d-ef29-4180-ae8a-2b4880ac0284) service to localhost/127.0.0.1:38107 2023-02-11 22:03:53,454 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/cluster_671774f5-443c-f981-5428-0cb7467049e2/dfs/data/data1/current/BP-780540192-172.31.2.10-1676153029102] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:53,454 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/cluster_671774f5-443c-f981-5428-0cb7467049e2/dfs/data/data2/current/BP-780540192-172.31.2.10-1676153029102] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:53,463 INFO [Listener at localhost/39979] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:53,576 INFO [Listener at localhost/39979] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 22:03:53,595 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 22:03:53,606 INFO [Listener at localhost/39979] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=272 (was 252) Potentially hanging thread: (jenkins-hbase9.apache.org,35753,1676153029714)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:38107 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:38107 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:38107 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:38107 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:38107 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38107 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39979 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:38107 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=578 (was 661), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=271 (was 286), ProcessCount=166 (was 166), AvailableMemoryMB=9578 (was 9626) 2023-02-11 22:03:53,616 INFO [Listener at localhost/39979] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=272, OpenFileDescriptor=578, MaxFileDescriptor=60000, SystemLoadAverage=271, ProcessCount=166, AvailableMemoryMB=9578 2023-02-11 22:03:53,626 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/hadoop.log.dir so I do NOT create it in target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c 2023-02-11 22:03:53,626 WARN [Listener at localhost/39979] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 22:03:53,626 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/hadoop.tmp.dir so I do NOT create it in target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c 2023-02-11 22:03:53,626 WARN [Listener at localhost/39979] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/94650bc1-a8da-fec8-a395-83cde309b33d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 22:03:53,626 DEBUG [Listener at localhost/39979] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c 2023-02-11 22:03:53,626 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 22:03:53,626 INFO [Listener at localhost/39979] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/cluster_53c08581-4388-9476-8765-3aee71e08e15, deleteOnExit=true 2023-02-11 22:03:53,626 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 22:03:53,627 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/test.cache.data in system properties and HBase conf 2023-02-11 22:03:53,627 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 22:03:53,627 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/hadoop.log.dir in system properties and HBase conf 2023-02-11 22:03:53,627 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 22:03:53,627 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 22:03:53,627 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 22:03:53,627 DEBUG [Listener at localhost/39979] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 22:03:53,627 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:53,628 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 22:03:53,628 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 22:03:53,628 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:53,628 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 22:03:53,628 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 22:03:53,628 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 22:03:53,628 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:53,628 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 22:03:53,628 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/nfs.dump.dir in system properties and HBase conf 2023-02-11 22:03:53,628 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/java.io.tmpdir in system properties and HBase conf 2023-02-11 22:03:53,628 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 22:03:53,628 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 22:03:53,629 INFO [Listener at localhost/39979] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 22:03:53,632 WARN [Listener at localhost/39979] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:53,633 WARN [Listener at localhost/39979] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:53,679 WARN [Listener at localhost/39979] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:53,680 INFO [Listener at localhost/39979] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:53,688 INFO [Listener at localhost/39979] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/java.io.tmpdir/Jetty_localhost_34639_hdfs____r1knnp/webapp 2023-02-11 22:03:53,795 INFO [Listener at localhost/39979] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34639 2023-02-11 22:03:53,799 WARN [Listener at localhost/39979] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 22:03:53,799 WARN [Listener at localhost/39979] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 22:03:53,839 WARN [Listener at localhost/43029] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:53,854 WARN [Listener at localhost/43029] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:53,857 WARN [Listener at localhost/43029] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:53,858 INFO [Listener at localhost/43029] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:53,862 INFO [Listener at localhost/43029] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/java.io.tmpdir/Jetty_localhost_45259_datanode____6cbd7g/webapp 2023-02-11 22:03:53,953 INFO [Listener at localhost/43029] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45259 2023-02-11 22:03:53,966 WARN [Listener at localhost/43573] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:53,985 WARN [Listener at localhost/43573] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 22:03:53,988 WARN [Listener at localhost/43573] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 22:03:53,989 INFO [Listener at localhost/43573] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 22:03:53,993 INFO [Listener at localhost/43573] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/java.io.tmpdir/Jetty_localhost_35415_datanode____fnbel9/webapp 2023-02-11 22:03:54,085 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf57c6308ac229e7c: Processing first storage report for DS-cf88e945-bf80-49db-a884-366d29f3fbb6 from datanode 0f6aeac3-f516-4a02-b679-f2c22a22caaf 2023-02-11 22:03:54,085 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf57c6308ac229e7c: from storage DS-cf88e945-bf80-49db-a884-366d29f3fbb6 node DatanodeRegistration(127.0.0.1:38995, datanodeUuid=0f6aeac3-f516-4a02-b679-f2c22a22caaf, infoPort=42893, infoSecurePort=0, ipcPort=43573, storageInfo=lv=-57;cid=testClusterID;nsid=1620016454;c=1676153033635), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:54,085 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf57c6308ac229e7c: Processing first storage report for DS-95e0d75b-71ec-4a9b-9bf9-799cb0d9ee7c from datanode 0f6aeac3-f516-4a02-b679-f2c22a22caaf 2023-02-11 22:03:54,085 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf57c6308ac229e7c: from storage DS-95e0d75b-71ec-4a9b-9bf9-799cb0d9ee7c node DatanodeRegistration(127.0.0.1:38995, datanodeUuid=0f6aeac3-f516-4a02-b679-f2c22a22caaf, infoPort=42893, infoSecurePort=0, ipcPort=43573, storageInfo=lv=-57;cid=testClusterID;nsid=1620016454;c=1676153033635), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:54,092 INFO [Listener at localhost/43573] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35415 2023-02-11 22:03:54,101 WARN [Listener at localhost/45895] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 22:03:54,198 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28bc43bc169f88eb: Processing first storage report for DS-8bcc5a8d-0a21-4d68-b9a7-4e01805ed119 from datanode fbeb9fa8-3f8a-492b-90f5-6421083676eb 2023-02-11 22:03:54,198 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28bc43bc169f88eb: from storage DS-8bcc5a8d-0a21-4d68-b9a7-4e01805ed119 node DatanodeRegistration(127.0.0.1:45371, datanodeUuid=fbeb9fa8-3f8a-492b-90f5-6421083676eb, infoPort=42489, infoSecurePort=0, ipcPort=45895, storageInfo=lv=-57;cid=testClusterID;nsid=1620016454;c=1676153033635), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:54,198 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28bc43bc169f88eb: Processing first storage report for DS-183ee6ce-25c9-41cf-ae5d-3a54c7bee0af from datanode fbeb9fa8-3f8a-492b-90f5-6421083676eb 2023-02-11 22:03:54,198 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28bc43bc169f88eb: from storage DS-183ee6ce-25c9-41cf-ae5d-3a54c7bee0af node DatanodeRegistration(127.0.0.1:45371, datanodeUuid=fbeb9fa8-3f8a-492b-90f5-6421083676eb, infoPort=42489, infoSecurePort=0, ipcPort=45895, storageInfo=lv=-57;cid=testClusterID;nsid=1620016454;c=1676153033635), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 22:03:54,211 DEBUG [Listener at localhost/45895] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c 2023-02-11 22:03:54,214 INFO [Listener at localhost/45895] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/cluster_53c08581-4388-9476-8765-3aee71e08e15/zookeeper_0, clientPort=64520, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/cluster_53c08581-4388-9476-8765-3aee71e08e15/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/cluster_53c08581-4388-9476-8765-3aee71e08e15/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 22:03:54,215 INFO [Listener at localhost/45895] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64520 2023-02-11 22:03:54,215 INFO [Listener at localhost/45895] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:54,216 INFO [Listener at localhost/45895] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:54,235 INFO [Listener at localhost/45895] util.FSUtils(479): Created version file at hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8 with version=8 2023-02-11 22:03:54,236 INFO [Listener at localhost/45895] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:54,237 INFO [Listener at localhost/45895] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:54,238 INFO [Listener at localhost/45895] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43029/user/jenkins/test-data/d0daee95-77ee-b8d9-da8a-a94d12c8df75/hbase-staging 2023-02-11 22:03:54,239 INFO [Listener at localhost/45895] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:54,239 INFO [Listener at localhost/45895] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:54,240 INFO [Listener at localhost/45895] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:54,240 INFO [Listener at localhost/45895] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:54,240 INFO [Listener at localhost/45895] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:54,240 INFO [Listener at localhost/45895] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:54,240 INFO [Listener at localhost/45895] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:54,240 INFO [Listener at localhost/45895] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39877 2023-02-11 22:03:54,241 INFO [Listener at localhost/45895] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:54,241 INFO [Listener at localhost/45895] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:54,242 INFO [Listener at localhost/45895] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39877 connecting to ZooKeeper ensemble=127.0.0.1:64520 2023-02-11 22:03:54,250 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:398770x0, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:54,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39877-0x100456a75d30000 connected 2023-02-11 22:03:54,275 DEBUG [Listener at localhost/45895] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:54,275 DEBUG [Listener at localhost/45895] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:54,276 DEBUG [Listener at localhost/45895] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:54,279 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39877 2023-02-11 22:03:54,280 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39877 2023-02-11 22:03:54,283 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39877 2023-02-11 22:03:54,283 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39877 2023-02-11 22:03:54,287 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39877 2023-02-11 22:03:54,287 INFO [Listener at localhost/45895] master.HMaster(439): hbase.rootdir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8, hbase.cluster.distributed=false 2023-02-11 22:03:54,304 INFO [Listener at localhost/45895] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:54,304 INFO [Listener at localhost/45895] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:54,304 INFO [Listener at localhost/45895] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:54,305 INFO [Listener at localhost/45895] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:54,305 INFO [Listener at localhost/45895] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:54,305 INFO [Listener at localhost/45895] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:54,305 INFO [Listener at localhost/45895] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:54,305 INFO [Listener at localhost/45895] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39383 2023-02-11 22:03:54,306 INFO [Listener at localhost/45895] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:54,308 DEBUG [Listener at localhost/45895] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:54,309 INFO [Listener at localhost/45895] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:54,309 INFO [Listener at localhost/45895] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:54,310 INFO [Listener at localhost/45895] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39383 connecting to ZooKeeper ensemble=127.0.0.1:64520 2023-02-11 22:03:54,312 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:393830x0, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:54,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39383-0x100456a75d30001 connected 2023-02-11 22:03:54,315 DEBUG [Listener at localhost/45895] zookeeper.ZKUtil(164): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:54,316 DEBUG [Listener at localhost/45895] zookeeper.ZKUtil(164): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:54,316 DEBUG [Listener at localhost/45895] zookeeper.ZKUtil(164): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:54,316 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39383 2023-02-11 22:03:54,317 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39383 2023-02-11 22:03:54,317 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39383 2023-02-11 22:03:54,322 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39383 2023-02-11 22:03:54,323 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39383 2023-02-11 22:03:54,333 INFO [Listener at localhost/45895] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-11 22:03:54,333 INFO [Listener at localhost/45895] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:54,333 INFO [Listener at localhost/45895] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:54,333 INFO [Listener at localhost/45895] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 22:03:54,333 INFO [Listener at localhost/45895] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 22:03:54,333 INFO [Listener at localhost/45895] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 22:03:54,333 INFO [Listener at localhost/45895] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 22:03:54,334 INFO [Listener at localhost/45895] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39967 2023-02-11 22:03:54,334 INFO [Listener at localhost/45895] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 22:03:54,335 DEBUG [Listener at localhost/45895] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:54,335 INFO [Listener at localhost/45895] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:54,336 INFO [Listener at localhost/45895] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:54,337 INFO [Listener at localhost/45895] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39967 connecting to ZooKeeper ensemble=127.0.0.1:64520 2023-02-11 22:03:54,339 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:399670x0, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 22:03:54,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39967-0x100456a75d30002 connected 2023-02-11 22:03:54,340 DEBUG [Listener at localhost/45895] zookeeper.ZKUtil(164): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:54,340 DEBUG [Listener at localhost/45895] zookeeper.ZKUtil(164): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:54,340 DEBUG [Listener at localhost/45895] zookeeper.ZKUtil(164): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 22:03:54,341 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39967 2023-02-11 22:03:54,343 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39967 2023-02-11 22:03:54,343 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39967 2023-02-11 22:03:54,343 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39967 2023-02-11 22:03:54,343 DEBUG [Listener at localhost/45895] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39967 2023-02-11 22:03:54,345 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,39877,1676153034239 2023-02-11 22:03:54,346 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:54,346 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,39877,1676153034239 2023-02-11 22:03:54,348 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:54,348 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:54,348 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:54,348 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:54,350 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:54,352 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,39877,1676153034239 from backup master directory 2023-02-11 22:03:54,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 22:03:54,353 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,39877,1676153034239 2023-02-11 22:03:54,353 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 22:03:54,353 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:54,353 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,39877,1676153034239 2023-02-11 22:03:54,365 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/hbase.id with ID: 9643ac80-27ac-439b-a295-ca039fa5a837 2023-02-11 22:03:54,373 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 22:03:54,375 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:54,384 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x62630f24 to 127.0.0.1:64520 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:54,387 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72f721b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:54,387 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:54,388 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 22:03:54,388 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:54,389 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/data/master/store-tmp 2023-02-11 22:03:54,397 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:54,397 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:54,397 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:54,397 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:54,397 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:54,397 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:54,397 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:54,397 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153034397Disabling compacts and flushes for region at 1676153034397Disabling writes for close at 1676153034397Writing region close event to WAL at 1676153034397Closed at 1676153034397 2023-02-11 22:03:54,398 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/WALs/jenkins-hbase9.apache.org,39877,1676153034239 2023-02-11 22:03:54,399 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39877%2C1676153034239, suffix=, logDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/WALs/jenkins-hbase9.apache.org,39877,1676153034239, archiveDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/oldWALs, maxLogs=10 2023-02-11 22:03:54,416 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38995,DS-cf88e945-bf80-49db-a884-366d29f3fbb6,DISK] 2023-02-11 22:03:54,417 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45371,DS-8bcc5a8d-0a21-4d68-b9a7-4e01805ed119,DISK] 2023-02-11 22:03:54,419 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/WALs/jenkins-hbase9.apache.org,39877,1676153034239/jenkins-hbase9.apache.org%2C39877%2C1676153034239.1676153034400 2023-02-11 22:03:54,419 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38995,DS-cf88e945-bf80-49db-a884-366d29f3fbb6,DISK], DatanodeInfoWithStorage[127.0.0.1:45371,DS-8bcc5a8d-0a21-4d68-b9a7-4e01805ed119,DISK]] 2023-02-11 22:03:54,419 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:54,419 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:54,419 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:54,419 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:54,422 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:54,424 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 22:03:54,424 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 22:03:54,425 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:54,425 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:54,425 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:54,427 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 22:03:54,428 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:54,429 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70683353, jitterRate=0.053264036774635315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:54,429 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676153034420Initializing all the Stores at 1676153034420Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153034420Cleaning up temporary data from old regions at 1676153034426 (+6 ms)Cleaning up detritus from prior splits at 1676153034426Region opened successfully at 1676153034429 (+3 ms) 2023-02-11 22:03:54,429 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 22:03:54,430 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 22:03:54,430 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 22:03:54,430 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 22:03:54,431 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 22:03:54,431 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 22:03:54,431 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 22:03:54,432 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 22:03:54,433 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 22:03:54,443 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 22:03:54,443 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 22:03:54,443 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 22:03:54,443 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 22:03:54,444 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 22:03:54,446 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:54,446 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 22:03:54,447 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 22:03:54,447 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 22:03:54,448 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:54,448 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:54,448 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:54,448 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:54,449 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,39877,1676153034239, sessionid=0x100456a75d30000, setting cluster-up flag (Was=false) 2023-02-11 22:03:54,454 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:54,457 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 22:03:54,458 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,39877,1676153034239 2023-02-11 22:03:54,461 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:54,464 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 22:03:54,465 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,39877,1676153034239 2023-02-11 22:03:54,465 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.hbase-snapshot/.tmp 2023-02-11 22:03:54,466 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:54,466 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:54,466 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:54,466 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:54,466 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-11 22:03:54,466 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-11 22:03:54,467 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,467 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:54,467 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,471 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676153064471 2023-02-11 22:03:54,471 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 22:03:54,471 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 22:03:54,471 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 22:03:54,471 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 22:03:54,472 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 22:03:54,472 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 22:03:54,472 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,472 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:54,472 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 22:03:54,472 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 22:03:54,472 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 22:03:54,473 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 22:03:54,473 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:54,474 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 22:03:54,474 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 22:03:54,474 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153034474,5,FailOnTimeoutGroup] 2023-02-11 22:03:54,474 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153034474,5,FailOnTimeoutGroup] 2023-02-11 22:03:54,474 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,474 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 22:03:54,474 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,474 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,481 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:54,481 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:54,481 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8 2023-02-11 22:03:54,489 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:54,490 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:54,490 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/info 2023-02-11 22:03:54,491 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:54,491 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:54,491 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:54,492 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:54,492 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:54,492 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:54,492 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:54,493 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/table 2023-02-11 22:03:54,493 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:54,494 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:54,494 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740 2023-02-11 22:03:54,494 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740 2023-02-11 22:03:54,496 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:54,496 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:54,498 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:54,498 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73165374, jitterRate=0.09024903178215027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:54,498 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676153034489Initializing all the Stores at 1676153034489Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153034489Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153034489Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153034489Cleaning up temporary data from old regions at 1676153034495 (+6 ms)Cleaning up detritus from prior splits at 1676153034495Region opened successfully at 1676153034498 (+3 ms) 2023-02-11 22:03:54,498 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:54,498 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:54,498 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:54,498 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:54,498 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:54,498 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:54,498 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153034498Disabling compacts and flushes for region at 1676153034498Disabling writes for close at 1676153034498Writing region close event to WAL at 1676153034498Closed at 1676153034498 2023-02-11 22:03:54,499 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 22:03:54,499 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 22:03:54,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 22:03:54,500 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 22:03:54,502 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 22:03:54,546 INFO [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(952): ClusterId : 9643ac80-27ac-439b-a295-ca039fa5a837 2023-02-11 22:03:54,546 INFO [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(952): ClusterId : 9643ac80-27ac-439b-a295-ca039fa5a837 2023-02-11 22:03:54,546 DEBUG [RS:1;jenkins-hbase9:39967] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:54,546 DEBUG [RS:0;jenkins-hbase9:39383] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 22:03:54,549 DEBUG [RS:1;jenkins-hbase9:39967] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:54,549 DEBUG [RS:1;jenkins-hbase9:39967] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:54,549 DEBUG [RS:0;jenkins-hbase9:39383] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 22:03:54,549 DEBUG [RS:0;jenkins-hbase9:39383] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 22:03:54,550 DEBUG [RS:1;jenkins-hbase9:39967] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:54,551 DEBUG [RS:1;jenkins-hbase9:39967] zookeeper.ReadOnlyZKClient(139): Connect 0x59c56f0f to 127.0.0.1:64520 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:54,551 DEBUG [RS:0;jenkins-hbase9:39383] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 22:03:54,552 DEBUG [RS:0;jenkins-hbase9:39383] zookeeper.ReadOnlyZKClient(139): Connect 0x7dd4b618 to 127.0.0.1:64520 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:54,556 DEBUG [RS:1;jenkins-hbase9:39967] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57028a47, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:54,556 DEBUG [RS:0;jenkins-hbase9:39383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@731347d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:54,557 DEBUG [RS:1;jenkins-hbase9:39967] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@533d047f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:54,557 DEBUG [RS:0;jenkins-hbase9:39383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@772cdd68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:54,565 DEBUG [RS:0;jenkins-hbase9:39383] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:39383 2023-02-11 22:03:54,565 INFO [RS:0;jenkins-hbase9:39383] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:54,565 INFO [RS:0;jenkins-hbase9:39383] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:54,565 DEBUG [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:54,565 INFO [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,39877,1676153034239 with isa=jenkins-hbase9.apache.org/172.31.2.10:39383, startcode=1676153034304 2023-02-11 22:03:54,565 DEBUG [RS:0;jenkins-hbase9:39383] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:54,567 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50055, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:54,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:54,569 DEBUG [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8 2023-02-11 22:03:54,569 DEBUG [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43029 2023-02-11 22:03:54,569 DEBUG [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:54,570 DEBUG [RS:1;jenkins-hbase9:39967] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:39967 2023-02-11 22:03:54,570 INFO [RS:1;jenkins-hbase9:39967] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 22:03:54,570 INFO [RS:1;jenkins-hbase9:39967] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 22:03:54,570 DEBUG [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 22:03:54,570 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:54,570 INFO [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,39877,1676153034239 with isa=jenkins-hbase9.apache.org/172.31.2.10:39967, startcode=1676153034333 2023-02-11 22:03:54,570 DEBUG [RS:1;jenkins-hbase9:39967] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 22:03:54,571 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,39383,1676153034304] 2023-02-11 22:03:54,575 DEBUG [RS:0;jenkins-hbase9:39383] zookeeper.ZKUtil(162): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:54,575 WARN [RS:0;jenkins-hbase9:39383] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:54,575 INFO [RS:0;jenkins-hbase9:39383] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:54,575 DEBUG [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/WALs/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:54,575 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51205, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 22:03:54,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:54,576 DEBUG [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8 2023-02-11 22:03:54,576 DEBUG [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43029 2023-02-11 22:03:54,577 DEBUG [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 22:03:54,582 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:54,582 DEBUG [RS:1;jenkins-hbase9:39967] zookeeper.ZKUtil(162): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:54,582 WARN [RS:1;jenkins-hbase9:39967] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 22:03:54,582 INFO [RS:1;jenkins-hbase9:39967] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:54,582 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,39967,1676153034333] 2023-02-11 22:03:54,582 DEBUG [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/WALs/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:54,582 DEBUG [RS:0;jenkins-hbase9:39383] zookeeper.ZKUtil(162): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:54,582 DEBUG [RS:0;jenkins-hbase9:39383] zookeeper.ZKUtil(162): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:54,584 DEBUG [RS:0;jenkins-hbase9:39383] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:54,584 INFO [RS:0;jenkins-hbase9:39383] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:54,585 DEBUG [RS:1;jenkins-hbase9:39967] zookeeper.ZKUtil(162): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:54,585 DEBUG [RS:1;jenkins-hbase9:39967] zookeeper.ZKUtil(162): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:54,585 INFO [RS:0;jenkins-hbase9:39383] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:54,586 INFO [RS:0;jenkins-hbase9:39383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:54,586 INFO [RS:0;jenkins-hbase9:39383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,586 DEBUG [RS:1;jenkins-hbase9:39967] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 22:03:54,586 INFO [RS:1;jenkins-hbase9:39967] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 22:03:54,587 INFO [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:54,589 INFO [RS:1;jenkins-hbase9:39967] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 22:03:54,590 INFO [RS:1;jenkins-hbase9:39967] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 22:03:54,590 INFO [RS:0;jenkins-hbase9:39383] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,590 INFO [RS:1;jenkins-hbase9:39967] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,590 DEBUG [RS:0;jenkins-hbase9:39383] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,590 DEBUG [RS:0;jenkins-hbase9:39383] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,590 INFO [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 22:03:54,590 DEBUG [RS:0;jenkins-hbase9:39383] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,591 DEBUG [RS:0;jenkins-hbase9:39383] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,591 DEBUG [RS:0;jenkins-hbase9:39383] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,591 DEBUG [RS:0;jenkins-hbase9:39383] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:54,591 DEBUG [RS:0;jenkins-hbase9:39383] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,591 DEBUG [RS:0;jenkins-hbase9:39383] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,591 DEBUG [RS:0;jenkins-hbase9:39383] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,591 DEBUG [RS:0;jenkins-hbase9:39383] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,595 INFO [RS:1;jenkins-hbase9:39967] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,595 DEBUG [RS:1;jenkins-hbase9:39967] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,595 INFO [RS:0;jenkins-hbase9:39383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,595 DEBUG [RS:1;jenkins-hbase9:39967] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,595 INFO [RS:0;jenkins-hbase9:39383] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,596 DEBUG [RS:1;jenkins-hbase9:39967] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,596 INFO [RS:0;jenkins-hbase9:39383] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,596 DEBUG [RS:1;jenkins-hbase9:39967] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,596 DEBUG [RS:1;jenkins-hbase9:39967] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,596 DEBUG [RS:1;jenkins-hbase9:39967] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-11 22:03:54,596 DEBUG [RS:1;jenkins-hbase9:39967] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,596 DEBUG [RS:1;jenkins-hbase9:39967] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,596 DEBUG [RS:1;jenkins-hbase9:39967] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,596 DEBUG [RS:1;jenkins-hbase9:39967] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-11 22:03:54,597 INFO [RS:1;jenkins-hbase9:39967] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,598 INFO [RS:1;jenkins-hbase9:39967] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,598 INFO [RS:1;jenkins-hbase9:39967] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,608 INFO [RS:0;jenkins-hbase9:39383] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:54,608 INFO [RS:0;jenkins-hbase9:39383] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39383,1676153034304-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,608 INFO [RS:1;jenkins-hbase9:39967] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 22:03:54,608 INFO [RS:1;jenkins-hbase9:39967] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39967,1676153034333-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,617 INFO [RS:0;jenkins-hbase9:39383] regionserver.Replication(203): jenkins-hbase9.apache.org,39383,1676153034304 started 2023-02-11 22:03:54,617 INFO [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,39383,1676153034304, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:39383, sessionid=0x100456a75d30001 2023-02-11 22:03:54,617 DEBUG [RS:0;jenkins-hbase9:39383] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:54,617 DEBUG [RS:0;jenkins-hbase9:39383] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:54,617 DEBUG [RS:0;jenkins-hbase9:39383] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39383,1676153034304' 2023-02-11 22:03:54,618 DEBUG [RS:0;jenkins-hbase9:39383] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:54,618 DEBUG [RS:0;jenkins-hbase9:39383] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:54,618 DEBUG [RS:0;jenkins-hbase9:39383] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:54,618 DEBUG [RS:0;jenkins-hbase9:39383] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:54,618 DEBUG [RS:0;jenkins-hbase9:39383] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:54,618 DEBUG [RS:0;jenkins-hbase9:39383] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39383,1676153034304' 2023-02-11 22:03:54,618 DEBUG [RS:0;jenkins-hbase9:39383] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:54,618 DEBUG [RS:0;jenkins-hbase9:39383] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:54,619 DEBUG [RS:0;jenkins-hbase9:39383] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:54,619 INFO [RS:0;jenkins-hbase9:39383] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:54,619 INFO [RS:0;jenkins-hbase9:39383] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:54,623 INFO [RS:1;jenkins-hbase9:39967] regionserver.Replication(203): jenkins-hbase9.apache.org,39967,1676153034333 started 2023-02-11 22:03:54,623 INFO [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,39967,1676153034333, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:39967, sessionid=0x100456a75d30002 2023-02-11 22:03:54,623 DEBUG [RS:1;jenkins-hbase9:39967] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 22:03:54,623 DEBUG [RS:1;jenkins-hbase9:39967] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:54,623 DEBUG [RS:1;jenkins-hbase9:39967] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39967,1676153034333' 2023-02-11 22:03:54,623 DEBUG [RS:1;jenkins-hbase9:39967] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:54,624 DEBUG [RS:1;jenkins-hbase9:39967] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:54,624 DEBUG [RS:1;jenkins-hbase9:39967] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 22:03:54,624 DEBUG [RS:1;jenkins-hbase9:39967] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 22:03:54,624 DEBUG [RS:1;jenkins-hbase9:39967] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:54,624 DEBUG [RS:1;jenkins-hbase9:39967] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39967,1676153034333' 2023-02-11 22:03:54,624 DEBUG [RS:1;jenkins-hbase9:39967] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:54,624 DEBUG [RS:1;jenkins-hbase9:39967] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:54,624 DEBUG [RS:1;jenkins-hbase9:39967] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 22:03:54,624 INFO [RS:1;jenkins-hbase9:39967] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 22:03:54,625 INFO [RS:1;jenkins-hbase9:39967] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 22:03:54,652 DEBUG [jenkins-hbase9:39877] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 22:03:54,652 DEBUG [jenkins-hbase9:39877] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:54,653 DEBUG [jenkins-hbase9:39877] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:54,653 DEBUG [jenkins-hbase9:39877] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:54,654 DEBUG [jenkins-hbase9:39877] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:54,654 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,39383,1676153034304, state=OPENING 2023-02-11 22:03:54,655 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 22:03:54,656 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:54,656 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:54,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,39383,1676153034304}] 2023-02-11 22:03:54,811 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:54,811 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 22:03:54,813 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48082, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 22:03:54,817 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 22:03:54,817 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 22:03:54,818 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39383%2C1676153034304.meta, suffix=.meta, logDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/WALs/jenkins-hbase9.apache.org,39383,1676153034304, archiveDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/oldWALs, maxLogs=32 2023-02-11 22:03:54,832 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38995,DS-cf88e945-bf80-49db-a884-366d29f3fbb6,DISK] 2023-02-11 22:03:54,832 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45371,DS-8bcc5a8d-0a21-4d68-b9a7-4e01805ed119,DISK] 2023-02-11 22:03:54,833 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/WALs/jenkins-hbase9.apache.org,39383,1676153034304/jenkins-hbase9.apache.org%2C39383%2C1676153034304.meta.1676153034818.meta 2023-02-11 22:03:54,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38995,DS-cf88e945-bf80-49db-a884-366d29f3fbb6,DISK], DatanodeInfoWithStorage[127.0.0.1:45371,DS-8bcc5a8d-0a21-4d68-b9a7-4e01805ed119,DISK]] 2023-02-11 22:03:54,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:54,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 22:03:54,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 22:03:54,834 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 22:03:54,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 22:03:54,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:54,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 22:03:54,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 22:03:54,835 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 22:03:54,836 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/info 2023-02-11 22:03:54,836 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/info 2023-02-11 22:03:54,836 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 22:03:54,837 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:54,837 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 22:03:54,837 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:54,837 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/rep_barrier 2023-02-11 22:03:54,838 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 22:03:54,838 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:54,838 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 22:03:54,838 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/table 2023-02-11 22:03:54,838 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/table 2023-02-11 22:03:54,839 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 22:03:54,839 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:54,839 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740 2023-02-11 22:03:54,840 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740 2023-02-11 22:03:54,841 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 22:03:54,842 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 22:03:54,842 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59820655, jitterRate=-0.10860277712345123}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 22:03:54,842 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676153034834Writing region info on filesystem at 1676153034834Initializing all the Stores at 1676153034835 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153034835Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153034835Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153034835Cleaning up temporary data from old regions at 1676153034841 (+6 ms)Cleaning up detritus from prior splits at 1676153034841Running coprocessor post-open hooks at 1676153034842 (+1 ms)Region opened successfully at 1676153034842 2023-02-11 22:03:54,843 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676153034811 2023-02-11 22:03:54,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 22:03:54,847 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 22:03:54,847 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,39383,1676153034304, state=OPEN 2023-02-11 22:03:54,849 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 22:03:54,849 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 22:03:54,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 22:03:54,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,39383,1676153034304 in 193 msec 2023-02-11 22:03:54,851 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 22:03:54,851 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 351 msec 2023-02-11 22:03:54,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 386 msec 2023-02-11 22:03:54,852 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676153034346, completionTime=-1 2023-02-11 22:03:54,852 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 22:03:54,853 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 22:03:54,855 DEBUG [hconnection-0x4ab9e583-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:54,856 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48096, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:54,857 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 22:03:54,857 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676153094857 2023-02-11 22:03:54,858 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676153154858 2023-02-11 22:03:54,858 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-11 22:03:54,862 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39877,1676153034239-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,862 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39877,1676153034239-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,862 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39877,1676153034239-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,862 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:39877, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,862 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 22:03:54,862 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 22:03:54,862 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:54,863 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 22:03:54,864 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 22:03:54,864 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:54,865 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:54,866 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4 2023-02-11 22:03:54,867 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4 empty. 2023-02-11 22:03:54,867 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4 2023-02-11 22:03:54,867 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 22:03:54,878 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:54,879 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 52efdc7ad626d3a78e94fa9777591ba4, NAME => 'hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp 2023-02-11 22:03:54,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:54,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 52efdc7ad626d3a78e94fa9777591ba4, disabling compactions & flushes 2023-02-11 22:03:54,885 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. 2023-02-11 22:03:54,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. 2023-02-11 22:03:54,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. after waiting 0 ms 2023-02-11 22:03:54,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. 2023-02-11 22:03:54,885 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. 2023-02-11 22:03:54,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 52efdc7ad626d3a78e94fa9777591ba4: Waiting for close lock at 1676153034885Disabling compacts and flushes for region at 1676153034885Disabling writes for close at 1676153034885Writing region close event to WAL at 1676153034885Closed at 1676153034885 2023-02-11 22:03:54,886 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:54,887 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153034887"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153034887"}]},"ts":"1676153034887"} 2023-02-11 22:03:54,888 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 22:03:54,889 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:54,889 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153034889"}]},"ts":"1676153034889"} 2023-02-11 22:03:54,890 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 22:03:54,894 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:54,895 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:54,895 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:54,895 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:54,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=52efdc7ad626d3a78e94fa9777591ba4, ASSIGN}] 2023-02-11 22:03:54,899 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=52efdc7ad626d3a78e94fa9777591ba4, ASSIGN 2023-02-11 22:03:54,899 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=52efdc7ad626d3a78e94fa9777591ba4, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39967,1676153034333; forceNewPlan=false, retain=false 2023-02-11 22:03:55,049 INFO [jenkins-hbase9:39877] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 22:03:55,050 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=52efdc7ad626d3a78e94fa9777591ba4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:55,050 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153035050"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153035050"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153035050"}]},"ts":"1676153035050"} 2023-02-11 22:03:55,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 52efdc7ad626d3a78e94fa9777591ba4, server=jenkins-hbase9.apache.org,39967,1676153034333}] 2023-02-11 22:03:55,204 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:55,204 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 22:03:55,206 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44866, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 22:03:55,209 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. 2023-02-11 22:03:55,210 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39967%2C1676153034333, suffix=, logDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/WALs/jenkins-hbase9.apache.org,39967,1676153034333, archiveDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/oldWALs, maxLogs=32 2023-02-11 22:03:55,223 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45371,DS-8bcc5a8d-0a21-4d68-b9a7-4e01805ed119,DISK] 2023-02-11 22:03:55,224 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38995,DS-cf88e945-bf80-49db-a884-366d29f3fbb6,DISK] 2023-02-11 22:03:55,225 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/WALs/jenkins-hbase9.apache.org,39967,1676153034333/jenkins-hbase9.apache.org%2C39967%2C1676153034333.1676153035210 2023-02-11 22:03:55,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45371,DS-8bcc5a8d-0a21-4d68-b9a7-4e01805ed119,DISK], DatanodeInfoWithStorage[127.0.0.1:38995,DS-cf88e945-bf80-49db-a884-366d29f3fbb6,DISK]] 2023-02-11 22:03:55,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 52efdc7ad626d3a78e94fa9777591ba4, NAME => 'hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:55,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 52efdc7ad626d3a78e94fa9777591ba4 2023-02-11 22:03:55,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:55,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 52efdc7ad626d3a78e94fa9777591ba4 2023-02-11 22:03:55,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 52efdc7ad626d3a78e94fa9777591ba4 2023-02-11 22:03:55,227 INFO [StoreOpener-52efdc7ad626d3a78e94fa9777591ba4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 52efdc7ad626d3a78e94fa9777591ba4 2023-02-11 22:03:55,228 DEBUG [StoreOpener-52efdc7ad626d3a78e94fa9777591ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4/info 2023-02-11 22:03:55,228 DEBUG [StoreOpener-52efdc7ad626d3a78e94fa9777591ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4/info 2023-02-11 22:03:55,228 INFO [StoreOpener-52efdc7ad626d3a78e94fa9777591ba4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52efdc7ad626d3a78e94fa9777591ba4 columnFamilyName info 2023-02-11 22:03:55,229 INFO [StoreOpener-52efdc7ad626d3a78e94fa9777591ba4-1] regionserver.HStore(310): Store=52efdc7ad626d3a78e94fa9777591ba4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:55,230 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4 2023-02-11 22:03:55,230 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4 2023-02-11 22:03:55,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 52efdc7ad626d3a78e94fa9777591ba4 2023-02-11 22:03:55,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:55,233 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 52efdc7ad626d3a78e94fa9777591ba4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59347356, jitterRate=-0.11565548181533813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 22:03:55,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 52efdc7ad626d3a78e94fa9777591ba4: Running coprocessor pre-open hook at 1676153035226Writing region info on filesystem at 1676153035226Initializing all the Stores at 1676153035227 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676153035227Cleaning up temporary data from old regions at 1676153035230 (+3 ms)Cleaning up detritus from prior splits at 1676153035231 (+1 ms)Running coprocessor post-open hooks at 1676153035233 (+2 ms)Region opened successfully at 1676153035233 2023-02-11 22:03:55,234 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4., pid=6, masterSystemTime=1676153035204 2023-02-11 22:03:55,237 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. 2023-02-11 22:03:55,237 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. 2023-02-11 22:03:55,238 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=52efdc7ad626d3a78e94fa9777591ba4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:55,238 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676153035238"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153035238"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153035238"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153035238"}]},"ts":"1676153035238"} 2023-02-11 22:03:55,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 22:03:55,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 52efdc7ad626d3a78e94fa9777591ba4, server=jenkins-hbase9.apache.org,39967,1676153034333 in 188 msec 2023-02-11 22:03:55,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 22:03:55,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=52efdc7ad626d3a78e94fa9777591ba4, ASSIGN in 345 msec 2023-02-11 22:03:55,243 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:55,243 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153035243"}]},"ts":"1676153035243"} 2023-02-11 22:03:55,244 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 22:03:55,246 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:55,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 384 msec 2023-02-11 22:03:55,264 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 22:03:55,265 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:55,265 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:55,267 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:55,268 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44876, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:55,269 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 22:03:55,275 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:55,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-11 22:03:55,280 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 22:03:55,285 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 22:03:55,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 6 msec 2023-02-11 22:03:55,298 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 22:03:55,300 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 22:03:55,300 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.947sec 2023-02-11 22:03:55,300 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 22:03:55,300 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 22:03:55,300 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 22:03:55,300 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39877,1676153034239-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 22:03:55,300 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39877,1676153034239-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 22:03:55,302 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 22:03:55,346 DEBUG [Listener at localhost/45895] zookeeper.ReadOnlyZKClient(139): Connect 0x18b47867 to 127.0.0.1:64520 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:55,349 DEBUG [Listener at localhost/45895] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ba76bf3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:55,350 DEBUG [hconnection-0x45033c97-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:55,353 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48100, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:55,354 INFO [Listener at localhost/45895] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,39877,1676153034239 2023-02-11 22:03:55,354 DEBUG [Listener at localhost/45895] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 22:03:55,356 DEBUG [Listener at localhost/45895] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 22:03:55,357 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46552, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 22:03:55,358 INFO [Listener at localhost/45895] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 22:03:55,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-11 22:03:55,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 22:03:55,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.2.10:46552 deadline: 1676153095358, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-11 22:03:55,359 INFO [Listener at localhost/45895] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-11 22:03:55,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 22:03:55,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-11 22:03:55,363 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 22:03:55,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-11 22:03:55,363 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 22:03:55,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:55,365 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:55,365 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca empty. 2023-02-11 22:03:55,365 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:55,365 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 22:03:55,372 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-11 22:03:55,373 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => dbe5c6bc7df62238ce9e65af19be9cca, NAME => 'testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp 2023-02-11 22:03:55,378 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:55,378 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing dbe5c6bc7df62238ce9e65af19be9cca, disabling compactions & flushes 2023-02-11 22:03:55,378 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:55,379 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:55,379 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. after waiting 0 ms 2023-02-11 22:03:55,379 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:55,379 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:55,379 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for dbe5c6bc7df62238ce9e65af19be9cca: Waiting for close lock at 1676153035378Disabling compacts and flushes for region at 1676153035378Disabling writes for close at 1676153035379 (+1 ms)Writing region close event to WAL at 1676153035379Closed at 1676153035379 2023-02-11 22:03:55,380 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 22:03:55,381 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676153035381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153035381"}]},"ts":"1676153035381"} 2023-02-11 22:03:55,382 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 22:03:55,383 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 22:03:55,383 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153035383"}]},"ts":"1676153035383"} 2023-02-11 22:03:55,384 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-11 22:03:55,387 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-11 22:03:55,388 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 22:03:55,388 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 22:03:55,388 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 22:03:55,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dbe5c6bc7df62238ce9e65af19be9cca, ASSIGN}] 2023-02-11 22:03:55,389 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dbe5c6bc7df62238ce9e65af19be9cca, ASSIGN 2023-02-11 22:03:55,389 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dbe5c6bc7df62238ce9e65af19be9cca, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39383,1676153034304; forceNewPlan=false, retain=false 2023-02-11 22:03:55,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:55,539 INFO [jenkins-hbase9:39877] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 22:03:55,540 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=dbe5c6bc7df62238ce9e65af19be9cca, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:55,540 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676153035540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153035540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153035540"}]},"ts":"1676153035540"} 2023-02-11 22:03:55,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure dbe5c6bc7df62238ce9e65af19be9cca, server=jenkins-hbase9.apache.org,39383,1676153034304}] 2023-02-11 22:03:55,620 INFO [RS:0;jenkins-hbase9:39383] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39383%2C1676153034304, suffix=, logDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/WALs/jenkins-hbase9.apache.org,39383,1676153034304, archiveDir=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/oldWALs, maxLogs=32 2023-02-11 22:03:55,633 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45371,DS-8bcc5a8d-0a21-4d68-b9a7-4e01805ed119,DISK] 2023-02-11 22:03:55,633 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38995,DS-cf88e945-bf80-49db-a884-366d29f3fbb6,DISK] 2023-02-11 22:03:55,635 INFO [RS:0;jenkins-hbase9:39383] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/WALs/jenkins-hbase9.apache.org,39383,1676153034304/jenkins-hbase9.apache.org%2C39383%2C1676153034304.1676153035620 2023-02-11 22:03:55,635 DEBUG [RS:0;jenkins-hbase9:39383] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45371,DS-8bcc5a8d-0a21-4d68-b9a7-4e01805ed119,DISK], DatanodeInfoWithStorage[127.0.0.1:38995,DS-cf88e945-bf80-49db-a884-366d29f3fbb6,DISK]] 2023-02-11 22:03:55,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:55,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:55,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dbe5c6bc7df62238ce9e65af19be9cca, NAME => 'testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.', STARTKEY => '', ENDKEY => ''} 2023-02-11 22:03:55,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:55,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:55,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:55,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:55,697 INFO [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:55,698 DEBUG [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1 2023-02-11 22:03:55,698 DEBUG [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1 2023-02-11 22:03:55,698 INFO [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbe5c6bc7df62238ce9e65af19be9cca columnFamilyName f1 2023-02-11 22:03:55,699 INFO [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] regionserver.HStore(310): Store=dbe5c6bc7df62238ce9e65af19be9cca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:55,699 INFO [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:55,700 DEBUG [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2 2023-02-11 22:03:55,700 DEBUG [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2 2023-02-11 22:03:55,700 INFO [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbe5c6bc7df62238ce9e65af19be9cca columnFamilyName f2 2023-02-11 22:03:55,700 INFO [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] regionserver.HStore(310): Store=dbe5c6bc7df62238ce9e65af19be9cca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:55,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:55,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:55,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:55,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:55,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 22:03:55,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened dbe5c6bc7df62238ce9e65af19be9cca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66490231, jitterRate=-0.009218350052833557}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:55,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for dbe5c6bc7df62238ce9e65af19be9cca: Running coprocessor pre-open hook at 1676153035696Writing region info on filesystem at 1676153035696Initializing all the Stores at 1676153035696Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153035697 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153035697Cleaning up temporary data from old regions at 1676153035702 (+5 ms)Cleaning up detritus from prior splits at 1676153035702Running coprocessor post-open hooks at 1676153035705 (+3 ms)Region opened successfully at 1676153035705 2023-02-11 22:03:55,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca., pid=12, masterSystemTime=1676153035693 2023-02-11 22:03:55,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:55,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:55,707 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=dbe5c6bc7df62238ce9e65af19be9cca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:55,707 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676153035707"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676153035707"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676153035707"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676153035707"}]},"ts":"1676153035707"} 2023-02-11 22:03:55,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-11 22:03:55,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure dbe5c6bc7df62238ce9e65af19be9cca, server=jenkins-hbase9.apache.org,39383,1676153034304 in 168 msec 2023-02-11 22:03:55,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 22:03:55,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dbe5c6bc7df62238ce9e65af19be9cca, ASSIGN in 322 msec 2023-02-11 22:03:55,712 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 22:03:55,712 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153035712"}]},"ts":"1676153035712"} 2023-02-11 22:03:55,713 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-11 22:03:55,715 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 22:03:55,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 354 msec 2023-02-11 22:03:55,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 22:03:55,968 INFO [Listener at localhost/45895] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-11 22:03:55,968 DEBUG [Listener at localhost/45895] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-11 22:03:55,969 INFO [Listener at localhost/45895] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:55,970 INFO [Listener at localhost/45895] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-11 22:03:55,971 INFO [Listener at localhost/45895] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 22:03:55,971 INFO [Listener at localhost/45895] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-11 22:03:55,971 INFO [Listener at localhost/45895] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 22:03:56,004 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39383] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:56,165 INFO [Listener at localhost/45895] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 22:03:56,165 INFO [Listener at localhost/45895] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 22:03:56,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 22:03:56,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676153036166 (current time:1676153036166). 2023-02-11 22:03:56,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 22:03:56,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] zookeeper.ReadOnlyZKClient(139): Connect 0x024aee54 to 127.0.0.1:64520 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 22:03:56,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c4f4417, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 22:03:56,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 22:03:56,171 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48110, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 22:03:56,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x024aee54 to 127.0.0.1:64520 2023-02-11 22:03:56,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:56,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 22:03:56,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 22:03:56,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 22:03:56,176 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 22:03:56,176 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676153636176 2023-02-11 22:03:56,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 22:03:56,176 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-11 22:03:56,177 DEBUG [Listener at localhost/45895] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:56,178 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 22:03:56,178 DEBUG [Listener at localhost/45895] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 22:03:56,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 22:03:56,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-11 22:03:56,179 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 22:03:56,180 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676153636180 2023-02-11 22:03:56,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-11 22:03:56,187 INFO [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-11 22:03:56,187 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:56,188 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-11 22:03:56,188 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-11 22:03:56,188 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,188 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 22:03:56,189 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:56,189 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:56,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:56,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:56,189 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 22:03:56,190 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 22:03:56,190 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:56,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-11 22:03:56,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 22:03:56,190 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-11 22:03:56,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-11 22:03:56,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 22:03:56,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-11 22:03:56,190 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-11 22:03:56,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-11 22:03:56,190 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-11 22:03:56,191 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:56,191 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 22:03:56,191 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-11 22:03:56,191 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39383,1676153034304' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-11 22:03:56,191 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-11 22:03:56,191 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 22:03:56,194 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 22:03:56,194 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-11 22:03:56,194 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39967,1676153034333' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-11 22:03:56,195 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,195 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:56,195 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,195 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:56,196 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:56,196 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,196 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 22:03:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:56,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39383,1676153034304' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-11 22:03:56,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6476f793[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:56,197 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-11 22:03:56,197 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,199 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,199 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,199 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 22:03:56,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,199 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,199 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:56,199 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 22:03:56,199 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-11 22:03:56,199 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 22:03:56,199 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-11 22:03:56,199 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:56,199 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,39967,1676153034333' in zk 2023-02-11 22:03:56,199 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. started... 2023-02-11 22:03:56,199 INFO [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] regionserver.HRegion(2744): Flushing dbe5c6bc7df62238ce9e65af19be9cca 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-11 22:03:56,200 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-11 22:03:56,200 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:56,201 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-11 22:03:56,209 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 22:03:56,216 INFO [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/.tmp/f1/5d0a517fb3a3462889ec67b96d68e823 2023-02-11 22:03:56,234 INFO [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/.tmp/f2/826c31db8c874aa3a4d9ed01e68692cb 2023-02-11 22:03:56,239 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/.tmp/f1/5d0a517fb3a3462889ec67b96d68e823 as hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1/5d0a517fb3a3462889ec67b96d68e823 2023-02-11 22:03:56,242 INFO [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1/5d0a517fb3a3462889ec67b96d68e823, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 22:03:56,243 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/.tmp/f2/826c31db8c874aa3a4d9ed01e68692cb as hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2/826c31db8c874aa3a4d9ed01e68692cb 2023-02-11 22:03:56,246 INFO [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2/826c31db8c874aa3a4d9ed01e68692cb, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 22:03:56,247 INFO [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for dbe5c6bc7df62238ce9e65af19be9cca in 48ms, sequenceid=5, compaction requested=false 2023-02-11 22:03:56,247 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for dbe5c6bc7df62238ce9e65af19be9cca: 2023-02-11 22:03:56,247 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-11 22:03:56,247 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 22:03:56,247 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1/5d0a517fb3a3462889ec67b96d68e823] hfiles 2023-02-11 22:03:56,247 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1/5d0a517fb3a3462889ec67b96d68e823 for snapshot=testWithMapReduceSingleRegion 2023-02-11 22:03:56,247 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2/826c31db8c874aa3a4d9ed01e68692cb] hfiles 2023-02-11 22:03:56,247 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2/826c31db8c874aa3a4d9ed01e68692cb for snapshot=testWithMapReduceSingleRegion 2023-02-11 22:03:56,261 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. completed. 2023-02-11 22:03:56,261 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:56,261 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-11 22:03:56,261 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-11 22:03:56,261 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,261 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-11 22:03:56,261 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,39383,1676153034304' in zk 2023-02-11 22:03:56,263 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,263 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-11 22:03:56,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:56,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:56,263 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:56,263 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-11 22:03:56,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:56,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 22:03:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 22:03:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase9.apache.org,39383,1676153034304': 2023-02-11 22:03:56,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39383,1676153034304' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-11 22:03:56,265 INFO [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-11 22:03:56,265 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:56,265 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:56,265 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-11 22:03:56,265 INFO [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 22:03:56,267 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,267 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,267 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 22:03:56,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,267 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:56,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,267 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:56,267 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:56,268 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 22:03:56,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:56,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:56,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:56,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 22:03:56,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,269 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:56,269 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 22:03:56,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,274 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:56,274 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 22:03:56,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:56,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:56,275 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:56,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 22:03:56,275 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:56,274 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 22:03:56,275 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-11 22:03:56,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:56,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-11 22:03:56,274 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 22:03:56,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:56,275 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 22:03:56,275 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,275 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 22:03:56,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 22:03:56,275 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 22:03:56,275 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,275 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-11 22:03:56,275 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 22:03:56,276 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 22:03:56,278 DEBUG [Listener at localhost/45895] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:56,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 22:03:56,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 22:03:56,279 DEBUG [Listener at localhost/45895] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 22:03:56,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-11 22:03:56,341 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-11 22:03:56,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-11 22:03:56,341 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-11 22:03:56,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676153036176Consolidate snapshot: testWithMapReduceSingleRegion at 1676153036275 (+99 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676153036275Writing data manifest for testWithMapReduceSingleRegion at 1676153036281 (+6 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676153036294 (+13 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676153036341 (+47 ms) 2023-02-11 22:03:56,342 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 22:03:56,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 165 msec 2023-02-11 22:03:56,479 DEBUG [Listener at localhost/45895] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 22:03:56,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 22:03:56,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 22:03:56,481 INFO [Listener at localhost/45895] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 22:03:56,484 INFO [Listener at localhost/45895] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 22:03:56,489 INFO [Listener at localhost/45895] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 22:03:56,520 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39383] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:56,599 INFO [Listener at localhost/45895] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 22:03:56,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-11 22:03:56,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-11 22:03:56,605 INFO [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-11 22:03:56,606 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:56,606 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-11 22:03:56,606 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-11 22:03:56,606 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,606 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:56,607 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,607 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:56,607 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:56,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:56,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:56,608 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,608 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 22:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:56,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:56,608 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 22:03:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 22:03:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:56,609 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 22:03:56,609 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 22:03:56,609 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 22:03:56,609 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 22:03:56,609 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 22:03:56,609 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:56,609 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 22:03:56,609 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 22:03:56,609 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 22:03:56,609 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 22:03:56,609 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39967,1676153034333' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 22:03:56,609 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 22:03:56,609 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 22:03:56,609 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:56,609 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. started... 2023-02-11 22:03:56,609 INFO [rs(jenkins-hbase9.apache.org,39383,1676153034304)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing dbe5c6bc7df62238ce9e65af19be9cca 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-11 22:03:56,610 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,611 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,611 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:56,629 INFO [rs(jenkins-hbase9.apache.org,39383,1676153034304)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/.tmp/f1/03a06fef1fed460ba6feb28e8ceb14e9 2023-02-11 22:03:56,653 INFO [rs(jenkins-hbase9.apache.org,39383,1676153034304)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/.tmp/f2/9290d04ec6d646f1827b54539e41db57 2023-02-11 22:03:56,656 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/.tmp/f1/03a06fef1fed460ba6feb28e8ceb14e9 as hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1/03a06fef1fed460ba6feb28e8ceb14e9 2023-02-11 22:03:56,660 INFO [rs(jenkins-hbase9.apache.org,39383,1676153034304)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1/03a06fef1fed460ba6feb28e8ceb14e9, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 22:03:56,660 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/.tmp/f2/9290d04ec6d646f1827b54539e41db57 as hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2/9290d04ec6d646f1827b54539e41db57 2023-02-11 22:03:56,664 INFO [rs(jenkins-hbase9.apache.org,39383,1676153034304)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2/9290d04ec6d646f1827b54539e41db57, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 22:03:56,665 INFO [rs(jenkins-hbase9.apache.org,39383,1676153034304)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for dbe5c6bc7df62238ce9e65af19be9cca in 56ms, sequenceid=9, compaction requested=false 2023-02-11 22:03:56,665 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for dbe5c6bc7df62238ce9e65af19be9cca: 2023-02-11 22:03:56,665 DEBUG [rs(jenkins-hbase9.apache.org,39383,1676153034304)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:56,665 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 22:03:56,665 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 22:03:56,665 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,665 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 22:03:56,665 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39383,1676153034304' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 22:03:56,668 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,668 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:56,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:56,668 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:56,668 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 22:03:56,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:56,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:56,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:56,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39383,1676153034304' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 22:03:56,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60497fc5[Count = 0] remaining members to acquire global barrier 2023-02-11 22:03:56,670 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-11 22:03:56,670 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,671 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,671 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,671 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 22:03:56,671 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,671 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 22:03:56,671 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 22:03:56,671 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,39383,1676153034304' in zk 2023-02-11 22:03:56,671 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 22:03:56,671 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 22:03:56,671 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,39967,1676153034333' in zk 2023-02-11 22:03:56,672 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,672 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 22:03:56,672 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:56,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:56,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:56,672 DEBUG [member: 'jenkins-hbase9.apache.org,39383,1676153034304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 22:03:56,673 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 22:03:56,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:56,673 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:56,673 DEBUG [member: 'jenkins-hbase9.apache.org,39967,1676153034333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 22:03:56,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:56,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:56,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:56,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:56,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,39383,1676153034304': 2023-02-11 22:03:56,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39383,1676153034304' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-11 22:03:56,675 INFO [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-11 22:03:56,675 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 22:03:56,675 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 22:03:56,675 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-11 22:03:56,675 INFO [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 22:03:56,677 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,677 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,677 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:56,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,677 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,677 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:56,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 22:03:56,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:56,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:56,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 22:03:56,678 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:56,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:56,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 22:03:56,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,678 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:56,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 22:03:56,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:56,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,680 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,680 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 22:03:56,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 22:03:56,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,682 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,682 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:56,682 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 22:03:56,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:56,682 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:56,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-11 22:03:56,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 22:03:56,682 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,682 DEBUG [(jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 22:03:56,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:56,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 22:03:56,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 22:03:56,683 DEBUG [Listener at localhost/45895] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-11 22:03:56,682 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:56,682 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 22:03:56,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:56,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:56,683 DEBUG [Listener at localhost/45895] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 22:03:56,682 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 22:03:56,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 22:03:56,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 22:03:56,683 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:56,683 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,683 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:56,683 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 22:03:56,683 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 22:03:56,783 DEBUG [Listener at localhost/45895] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 22:03:56,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 22:03:56,871 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/hadoop-1211861561133730617.jar 2023-02-11 22:03:56,875 INFO [Listener at localhost/45895] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676153036166 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:56,875 DEBUG [Listener at localhost/45895] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43029/user/jenkins/test-data/d0daee95-77ee-b8d9-da8a-a94d12c8df75/testWithMapReduceSingleRegion/c39eb3b7-d68a-4d3c-b80c-2905611bfcbd/data/default/testWithMapReduce 2023-02-11 22:03:56,875 INFO [Listener at localhost/45895] snapshot.RestoreSnapshotHelper(239): region to add: dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:56,875 INFO [Listener at localhost/45895] snapshot.RestoreSnapshotHelper(585): clone region=dbe5c6bc7df62238ce9e65af19be9cca as dbe5c6bc7df62238ce9e65af19be9cca in snapshot testWithMapReduceSingleRegion 2023-02-11 22:03:56,876 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => dbe5c6bc7df62238ce9e65af19be9cca, NAME => 'testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43029/user/jenkins/test-data/d0daee95-77ee-b8d9-da8a-a94d12c8df75/testWithMapReduceSingleRegion/c39eb3b7-d68a-4d3c-b80c-2905611bfcbd 2023-02-11 22:03:56,882 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:56,882 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5d0a517fb3a3462889ec67b96d68e823 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-11 22:03:56,883 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 826c31db8c874aa3a4d9ed01e68692cb from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-11 22:03:56,885 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing dbe5c6bc7df62238ce9e65af19be9cca, disabling compactions & flushes 2023-02-11 22:03:56,885 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:56,885 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:56,885 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. after waiting 0 ms 2023-02-11 22:03:56,885 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:56,885 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:56,885 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for dbe5c6bc7df62238ce9e65af19be9cca: Waiting for close lock at 1676153036885Disabling compacts and flushes for region at 1676153036885Disabling writes for close at 1676153036885Writing region close event to WAL at 1676153036885Closed at 1676153036885 2023-02-11 22:03:56,885 INFO [Listener at localhost/45895] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676153036166 type: FLUSH version: 2 ttl: 0 2023-02-11 22:03:56,886 DEBUG [Listener at localhost/45895] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43029/user/jenkins/test-data/d0daee95-77ee-b8d9-da8a-a94d12c8df75/testWithMapReduceSingleRegion/c39eb3b7-d68a-4d3c-b80c-2905611bfcbd 2023-02-11 22:03:56,886 DEBUG [Listener at localhost/45895] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43029/user/jenkins/test-data/d0daee95-77ee-b8d9-da8a-a94d12c8df75/testWithMapReduceSingleRegion/c39eb3b7-d68a-4d3c-b80c-2905611bfcbd 2023-02-11 22:03:56,886 DEBUG [Listener at localhost/45895] util.CommonFSUtils(699): |-data/ 2023-02-11 22:03:56,886 DEBUG [Listener at localhost/45895] util.CommonFSUtils(699): |----default/ 2023-02-11 22:03:56,886 DEBUG [Listener at localhost/45895] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-11 22:03:56,887 DEBUG [Listener at localhost/45895] util.CommonFSUtils(699): |----------dbe5c6bc7df62238ce9e65af19be9cca/ 2023-02-11 22:03:56,887 DEBUG [Listener at localhost/45895] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 22:03:56,887 DEBUG [Listener at localhost/45895] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 22:03:56,888 DEBUG [Listener at localhost/45895] util.CommonFSUtils(702): |----------------testWithMapReduce=dbe5c6bc7df62238ce9e65af19be9cca-5d0a517fb3a3462889ec67b96d68e823 2023-02-11 22:03:56,888 DEBUG [Listener at localhost/45895] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 22:03:56,888 DEBUG [Listener at localhost/45895] util.CommonFSUtils(702): |----------------testWithMapReduce=dbe5c6bc7df62238ce9e65af19be9cca-826c31db8c874aa3a4d9ed01e68692cb 2023-02-11 22:03:56,888 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,889 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,889 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,889 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,890 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,890 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,890 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,956 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/hadoop-8379154891208125944.jar 2023-02-11 22:03:56,956 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,956 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,957 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,957 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,957 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,958 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,958 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-11 22:03:56,958 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-11 22:03:56,959 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-11 22:03:56,959 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-11 22:03:56,960 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-11 22:03:56,960 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-11 22:03:56,961 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-11 22:03:56,961 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-11 22:03:56,961 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-11 22:03:56,962 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-11 22:03:56,962 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 22:03:56,962 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 22:03:56,963 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 22:03:56,963 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 22:03:56,963 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 22:03:57,029 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/hadoop-5519801163118708631.jar 2023-02-11 22:03:57,029 DEBUG [Listener at localhost/45895] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 22:03:57,035 WARN [Listener at localhost/45895] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-11 22:03:57,066 INFO [Listener at localhost/45895] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 22:03:57,146 WARN [Listener at localhost/45895] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/mapreduce.cluster.local.dir/1676153037112/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-11 22:03:57,146 WARN [Listener at localhost/45895] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/mapreduce.cluster.local.dir/1676153037112/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-11 22:03:57,177 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 22:03:57,178 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 22:03:57,178 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 22:03:57,180 INFO [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:57,181 DEBUG [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/d0daee95-77ee-b8d9-da8a-a94d12c8df75/testWithMapReduceSingleRegion/c39eb3b7-d68a-4d3c-b80c-2905611bfcbd/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1 2023-02-11 22:03:57,181 INFO [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbe5c6bc7df62238ce9e65af19be9cca columnFamilyName f1 2023-02-11 22:03:57,185 DEBUG [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] regionserver.HStore(539): loaded hdfs://localhost:43029/user/jenkins/test-data/d0daee95-77ee-b8d9-da8a-a94d12c8df75/testWithMapReduceSingleRegion/c39eb3b7-d68a-4d3c-b80c-2905611bfcbd/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1/testWithMapReduce=dbe5c6bc7df62238ce9e65af19be9cca-5d0a517fb3a3462889ec67b96d68e823 2023-02-11 22:03:57,185 INFO [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] regionserver.HStore(310): Store=dbe5c6bc7df62238ce9e65af19be9cca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:57,185 INFO [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:57,186 DEBUG [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43029/user/jenkins/test-data/d0daee95-77ee-b8d9-da8a-a94d12c8df75/testWithMapReduceSingleRegion/c39eb3b7-d68a-4d3c-b80c-2905611bfcbd/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2 2023-02-11 22:03:57,186 INFO [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbe5c6bc7df62238ce9e65af19be9cca columnFamilyName f2 2023-02-11 22:03:57,190 DEBUG [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] regionserver.HStore(539): loaded hdfs://localhost:43029/user/jenkins/test-data/d0daee95-77ee-b8d9-da8a-a94d12c8df75/testWithMapReduceSingleRegion/c39eb3b7-d68a-4d3c-b80c-2905611bfcbd/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2/testWithMapReduce=dbe5c6bc7df62238ce9e65af19be9cca-826c31db8c874aa3a4d9ed01e68692cb 2023-02-11 22:03:57,190 INFO [StoreOpener-dbe5c6bc7df62238ce9e65af19be9cca-1] regionserver.HStore(310): Store=dbe5c6bc7df62238ce9e65af19be9cca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 22:03:57,190 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 22:03:57,190 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dbe5c6bc7df62238ce9e65af19be9cca; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64437922, jitterRate=-0.03980013728141785}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 22:03:57,190 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dbe5c6bc7df62238ce9e65af19be9cca: Writing region info on filesystem at 1676153037178Initializing all the Stores at 1676153037179 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153037179Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676153037179Region opened successfully at 1676153037190 (+11 ms) 2023-02-11 22:03:57,273 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dbe5c6bc7df62238ce9e65af19be9cca, disabling compactions & flushes 2023-02-11 22:03:57,273 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:57,273 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:57,273 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. after waiting 0 ms 2023-02-11 22:03:57,273 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:57,274 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:57,274 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dbe5c6bc7df62238ce9e65af19be9cca: Waiting for close lock at 1676153037273Disabling compacts and flushes for region at 1676153037273Disabling writes for close at 1676153037273Writing region close event to WAL at 1676153037274 (+1 ms)Closed at 1676153037274 2023-02-11 22:03:58,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "testWithMapReduceSingleRegion" 2023-02-11 22:03:58,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-11 22:03:58,183 INFO [Listener at localhost/45895] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 22:03:58,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-11 22:03:58,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-11 22:03:58,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 22:03:58,188 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153038188"}]},"ts":"1676153038188"} 2023-02-11 22:03:58,189 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-11 22:03:58,191 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-11 22:03:58,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=dbe5c6bc7df62238ce9e65af19be9cca, UNASSIGN}] 2023-02-11 22:03:58,192 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=dbe5c6bc7df62238ce9e65af19be9cca, UNASSIGN 2023-02-11 22:03:58,192 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=dbe5c6bc7df62238ce9e65af19be9cca, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:58,193 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676153038192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676153038192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676153038192"}]},"ts":"1676153038192"} 2023-02-11 22:03:58,194 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure dbe5c6bc7df62238ce9e65af19be9cca, server=jenkins-hbase9.apache.org,39383,1676153034304}] 2023-02-11 22:03:58,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 22:03:58,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:58,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing dbe5c6bc7df62238ce9e65af19be9cca, disabling compactions & flushes 2023-02-11 22:03:58,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:58,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:58,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. after waiting 0 ms 2023-02-11 22:03:58,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:58,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 22:03:58,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca. 2023-02-11 22:03:58,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for dbe5c6bc7df62238ce9e65af19be9cca: Waiting for close lock at 1676153038346Running coprocessor pre-close hooks at 1676153038346Disabling compacts and flushes for region at 1676153038346Disabling writes for close at 1676153038346Writing region close event to WAL at 1676153038347 (+1 ms)Running coprocessor post-close hooks at 1676153038350 (+3 ms)Closed at 1676153038351 (+1 ms) 2023-02-11 22:03:58,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:58,353 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=dbe5c6bc7df62238ce9e65af19be9cca, regionState=CLOSED 2023-02-11 22:03:58,353 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676153038353"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676153038353"}]},"ts":"1676153038353"} 2023-02-11 22:03:58,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-11 22:03:58,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure dbe5c6bc7df62238ce9e65af19be9cca, server=jenkins-hbase9.apache.org,39383,1676153034304 in 160 msec 2023-02-11 22:03:58,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 22:03:58,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dbe5c6bc7df62238ce9e65af19be9cca, UNASSIGN in 164 msec 2023-02-11 22:03:58,357 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676153038357"}]},"ts":"1676153038357"} 2023-02-11 22:03:58,358 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-11 22:03:58,360 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-11 22:03:58,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 176 msec 2023-02-11 22:03:58,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 22:03:58,489 INFO [Listener at localhost/45895] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-11 22:03:58,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testWithMapReduce 2023-02-11 22:03:58,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-11 22:03:58,492 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 22:03:58,493 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 22:03:58,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 22:03:58,496 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:58,498 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1, FileablePath, hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2, FileablePath, hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/recovered.edits] 2023-02-11 22:03:58,500 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1/03a06fef1fed460ba6feb28e8ceb14e9 to hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/archive/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1/03a06fef1fed460ba6feb28e8ceb14e9 2023-02-11 22:03:58,501 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1/5d0a517fb3a3462889ec67b96d68e823 to hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/archive/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f1/5d0a517fb3a3462889ec67b96d68e823 2023-02-11 22:03:58,503 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2/826c31db8c874aa3a4d9ed01e68692cb to hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/archive/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2/826c31db8c874aa3a4d9ed01e68692cb 2023-02-11 22:03:58,504 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2/9290d04ec6d646f1827b54539e41db57 to hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/archive/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/f2/9290d04ec6d646f1827b54539e41db57 2023-02-11 22:03:58,506 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/recovered.edits/12.seqid to hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/archive/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca/recovered.edits/12.seqid 2023-02-11 22:03:58,506 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/.tmp/data/default/testWithMapReduce/dbe5c6bc7df62238ce9e65af19be9cca 2023-02-11 22:03:58,506 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 22:03:58,508 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 22:03:58,510 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-11 22:03:58,511 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-11 22:03:58,512 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 22:03:58,512 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-11 22:03:58,512 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676153038512"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:58,513 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 22:03:58,513 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dbe5c6bc7df62238ce9e65af19be9cca, NAME => 'testWithMapReduce,,1676153035361.dbe5c6bc7df62238ce9e65af19be9cca.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 22:03:58,513 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-11 22:03:58,513 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676153038513"}]},"ts":"9223372036854775807"} 2023-02-11 22:03:58,514 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-11 22:03:58,518 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 22:03:58,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 28 msec 2023-02-11 22:03:58,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 22:03:58,595 INFO [Listener at localhost/45895] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-11 22:03:58,595 INFO [Listener at localhost/45895] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 22:03:58,595 INFO [Listener at localhost/45895] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 22:03:58,595 DEBUG [Listener at localhost/45895] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18b47867 to 127.0.0.1:64520 2023-02-11 22:03:58,595 DEBUG [Listener at localhost/45895] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:58,595 DEBUG [Listener at localhost/45895] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 22:03:58,595 DEBUG [Listener at localhost/45895] util.JVMClusterUtil(257): Found active master hash=2054224591, stopped=false 2023-02-11 22:03:58,596 INFO [Listener at localhost/45895] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,39877,1676153034239 2023-02-11 22:03:58,599 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:58,599 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:58,599 INFO [Listener at localhost/45895] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 22:03:58,599 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 22:03:58,599 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:58,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:58,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:58,602 DEBUG [Listener at localhost/45895] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62630f24 to 127.0.0.1:64520 2023-02-11 22:03:58,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 22:03:58,603 DEBUG [Listener at localhost/45895] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:58,603 INFO [Listener at localhost/45895] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,39383,1676153034304' ***** 2023-02-11 22:03:58,603 INFO [Listener at localhost/45895] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:58,603 INFO [Listener at localhost/45895] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,39967,1676153034333' ***** 2023-02-11 22:03:58,603 INFO [Listener at localhost/45895] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 22:03:58,603 INFO [RS:0;jenkins-hbase9:39383] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:58,603 INFO [RS:1;jenkins-hbase9:39967] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 22:03:58,603 INFO [RS:0;jenkins-hbase9:39383] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:58,603 INFO [RS:1;jenkins-hbase9:39967] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 22:03:58,603 INFO [RS:0;jenkins-hbase9:39383] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:58,603 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:58,603 INFO [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:58,603 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 22:03:58,604 DEBUG [RS:0;jenkins-hbase9:39383] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dd4b618 to 127.0.0.1:64520 2023-02-11 22:03:58,603 INFO [RS:1;jenkins-hbase9:39967] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 22:03:58,605 DEBUG [RS:0;jenkins-hbase9:39383] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:58,605 INFO [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(3304): Received CLOSE for 52efdc7ad626d3a78e94fa9777591ba4 2023-02-11 22:03:58,605 INFO [RS:0;jenkins-hbase9:39383] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:58,606 INFO [RS:0;jenkins-hbase9:39383] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:58,606 INFO [RS:0;jenkins-hbase9:39383] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:58,606 INFO [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:58,606 INFO [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 22:03:58,606 DEBUG [RS:1;jenkins-hbase9:39967] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59c56f0f to 127.0.0.1:64520 2023-02-11 22:03:58,606 DEBUG [RS:1;jenkins-hbase9:39967] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:58,606 INFO [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 22:03:58,606 INFO [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 22:03:58,606 DEBUG [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(1479): Online Regions={52efdc7ad626d3a78e94fa9777591ba4=hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4.} 2023-02-11 22:03:58,606 DEBUG [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-11 22:03:58,606 DEBUG [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(1505): Waiting on 52efdc7ad626d3a78e94fa9777591ba4 2023-02-11 22:03:58,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 52efdc7ad626d3a78e94fa9777591ba4, disabling compactions & flushes 2023-02-11 22:03:58,606 DEBUG [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 22:03:58,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. 2023-02-11 22:03:58,606 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 22:03:58,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. 2023-02-11 22:03:58,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 22:03:58,606 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 22:03:58,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. after waiting 0 ms 2023-02-11 22:03:58,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. 2023-02-11 22:03:58,606 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 22:03:58,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 52efdc7ad626d3a78e94fa9777591ba4 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 22:03:58,606 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 22:03:58,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-11 22:03:58,613 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:58,613 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:58,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4/.tmp/info/5614fd5a2b194a93a4a5956299196b1c 2023-02-11 22:03:58,617 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/.tmp/info/dfd09d5850dd4c90b9d23868fe17768e 2023-02-11 22:03:58,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4/.tmp/info/5614fd5a2b194a93a4a5956299196b1c as hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4/info/5614fd5a2b194a93a4a5956299196b1c 2023-02-11 22:03:58,621 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfd09d5850dd4c90b9d23868fe17768e 2023-02-11 22:03:58,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4/info/5614fd5a2b194a93a4a5956299196b1c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 22:03:58,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 52efdc7ad626d3a78e94fa9777591ba4 in 19ms, sequenceid=6, compaction requested=false 2023-02-11 22:03:58,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/.tmp/rep_barrier/4dfcf69ea7aa4729a969ecccf48f8e76 2023-02-11 22:03:58,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/namespace/52efdc7ad626d3a78e94fa9777591ba4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 22:03:58,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. 2023-02-11 22:03:58,630 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-11 22:03:58,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 52efdc7ad626d3a78e94fa9777591ba4: Waiting for close lock at 1676153038606Running coprocessor pre-close hooks at 1676153038606Disabling compacts and flushes for region at 1676153038606Disabling writes for close at 1676153038606Obtaining lock to block concurrent updates at 1676153038606Preparing flush snapshotting stores in 52efdc7ad626d3a78e94fa9777591ba4 at 1676153038606Finished memstore snapshotting hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676153038607 (+1 ms)Flushing stores of hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. at 1676153038607Flushing 52efdc7ad626d3a78e94fa9777591ba4/info: creating writer at 1676153038607Flushing 52efdc7ad626d3a78e94fa9777591ba4/info: appending metadata at 1676153038609 (+2 ms)Flushing 52efdc7ad626d3a78e94fa9777591ba4/info: closing flushed file at 1676153038609Flushing 52efdc7ad626d3a78e94fa9777591ba4/info: reopening flushed file at 1676153038621 (+12 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 52efdc7ad626d3a78e94fa9777591ba4 in 19ms, sequenceid=6, compaction requested=false at 1676153038625 (+4 ms)Writing region close event to WAL at 1676153038626 (+1 ms)Running coprocessor post-close hooks at 1676153038629 (+3 ms)Closed at 1676153038630 (+1 ms) 2023-02-11 22:03:58,631 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-11 22:03:58,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676153034862.52efdc7ad626d3a78e94fa9777591ba4. 2023-02-11 22:03:58,633 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4dfcf69ea7aa4729a969ecccf48f8e76 2023-02-11 22:03:58,639 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/.tmp/table/985ee289eff048cab8685a1647ea257d 2023-02-11 22:03:58,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 985ee289eff048cab8685a1647ea257d 2023-02-11 22:03:58,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/.tmp/info/dfd09d5850dd4c90b9d23868fe17768e as hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/info/dfd09d5850dd4c90b9d23868fe17768e 2023-02-11 22:03:58,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfd09d5850dd4c90b9d23868fe17768e 2023-02-11 22:03:58,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/info/dfd09d5850dd4c90b9d23868fe17768e, entries=12, sequenceid=21, filesize=6.2 K 2023-02-11 22:03:58,647 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/.tmp/rep_barrier/4dfcf69ea7aa4729a969ecccf48f8e76 as hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/rep_barrier/4dfcf69ea7aa4729a969ecccf48f8e76 2023-02-11 22:03:58,650 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4dfcf69ea7aa4729a969ecccf48f8e76 2023-02-11 22:03:58,650 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/rep_barrier/4dfcf69ea7aa4729a969ecccf48f8e76, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 22:03:58,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/.tmp/table/985ee289eff048cab8685a1647ea257d as hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/table/985ee289eff048cab8685a1647ea257d 2023-02-11 22:03:58,654 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 985ee289eff048cab8685a1647ea257d 2023-02-11 22:03:58,654 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/table/985ee289eff048cab8685a1647ea257d, entries=4, sequenceid=21, filesize=5.0 K 2023-02-11 22:03:58,655 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false 2023-02-11 22:03:58,657 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-11 22:03:58,658 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 22:03:58,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:58,659 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676153038606Running coprocessor pre-close hooks at 1676153038606Disabling compacts and flushes for region at 1676153038606Disabling writes for close at 1676153038606Obtaining lock to block concurrent updates at 1676153038606Preparing flush snapshotting stores in 1588230740 at 1676153038606Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676153038607 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676153038607Flushing 1588230740/info: creating writer at 1676153038607Flushing 1588230740/info: appending metadata at 1676153038609 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676153038609Flushing 1588230740/rep_barrier: creating writer at 1676153038621 (+12 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676153038623 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676153038623Flushing 1588230740/table: creating writer at 1676153038633 (+10 ms)Flushing 1588230740/table: appending metadata at 1676153038635 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676153038635Flushing 1588230740/info: reopening flushed file at 1676153038643 (+8 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676153038647 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676153038651 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false at 1676153038655 (+4 ms)Writing region close event to WAL at 1676153038655Running coprocessor post-close hooks at 1676153038658 (+3 ms)Closed at 1676153038659 (+1 ms) 2023-02-11 22:03:58,659 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 22:03:58,806 INFO [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,39967,1676153034333; all regions closed. 2023-02-11 22:03:58,806 INFO [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,39383,1676153034304; all regions closed. 2023-02-11 22:03:58,811 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/WALs/jenkins-hbase9.apache.org,39967,1676153034333/jenkins-hbase9.apache.org%2C39967%2C1676153034333.1676153035210 not finished, retry = 0 2023-02-11 22:03:58,811 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/WALs/jenkins-hbase9.apache.org,39383,1676153034304/jenkins-hbase9.apache.org%2C39383%2C1676153034304.meta.1676153034818.meta not finished, retry = 0 2023-02-11 22:03:58,913 DEBUG [RS:1;jenkins-hbase9:39967] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/oldWALs 2023-02-11 22:03:58,913 DEBUG [RS:0;jenkins-hbase9:39383] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/oldWALs 2023-02-11 22:03:58,913 INFO [RS:1;jenkins-hbase9:39967] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C39967%2C1676153034333:(num 1676153035210) 2023-02-11 22:03:58,913 DEBUG [RS:1;jenkins-hbase9:39967] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:58,913 INFO [RS:0;jenkins-hbase9:39383] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C39383%2C1676153034304.meta:.meta(num 1676153034818) 2023-02-11 22:03:58,913 INFO [RS:1;jenkins-hbase9:39967] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:58,913 INFO [RS:1;jenkins-hbase9:39967] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:58,914 INFO [RS:1;jenkins-hbase9:39967] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 22:03:58,914 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:58,914 INFO [RS:1;jenkins-hbase9:39967] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 22:03:58,914 INFO [RS:1;jenkins-hbase9:39967] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 22:03:58,915 INFO [RS:1;jenkins-hbase9:39967] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39967 2023-02-11 22:03:58,917 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:58,917 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:58,917 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:58,917 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39967,1676153034333 2023-02-11 22:03:58,917 ERROR [Listener at localhost/45895-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2afe988e rejected from java.util.concurrent.ThreadPoolExecutor@2ec11909[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:58,917 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:58,917 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,39967,1676153034333] 2023-02-11 22:03:58,917 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,39967,1676153034333; numProcessing=1 2023-02-11 22:03:58,918 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,39967,1676153034333 already deleted, retry=false 2023-02-11 22:03:58,918 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,39967,1676153034333 expired; onlineServers=1 2023-02-11 22:03:58,924 DEBUG [RS:0;jenkins-hbase9:39383] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/oldWALs 2023-02-11 22:03:58,924 INFO [RS:0;jenkins-hbase9:39383] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C39383%2C1676153034304:(num 1676153035620) 2023-02-11 22:03:58,924 DEBUG [RS:0;jenkins-hbase9:39383] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:58,924 INFO [RS:0;jenkins-hbase9:39383] regionserver.LeaseManager(133): Closed leases 2023-02-11 22:03:58,924 INFO [RS:0;jenkins-hbase9:39383] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 22:03:58,924 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:58,927 INFO [RS:0;jenkins-hbase9:39383] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39383 2023-02-11 22:03:58,929 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 22:03:58,929 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39383,1676153034304 2023-02-11 22:03:58,929 ERROR [Listener at localhost/45895-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@768f3a62 rejected from java.util.concurrent.ThreadPoolExecutor@72b0b06b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:58,929 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,39383,1676153034304] 2023-02-11 22:03:58,929 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,39383,1676153034304; numProcessing=2 2023-02-11 22:03:58,930 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,39383,1676153034304 already deleted, retry=false 2023-02-11 22:03:58,930 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,39383,1676153034304 expired; onlineServers=0 2023-02-11 22:03:58,930 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,39877,1676153034239' ***** 2023-02-11 22:03:58,930 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 22:03:58,931 DEBUG [M:0;jenkins-hbase9:39877] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e4f7159, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-11 22:03:58,931 INFO [M:0;jenkins-hbase9:39877] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,39877,1676153034239 2023-02-11 22:03:58,931 INFO [M:0;jenkins-hbase9:39877] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,39877,1676153034239; all regions closed. 2023-02-11 22:03:58,931 DEBUG [M:0;jenkins-hbase9:39877] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 22:03:58,932 DEBUG [M:0;jenkins-hbase9:39877] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 22:03:58,932 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 22:03:58,932 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153034474] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676153034474,5,FailOnTimeoutGroup] 2023-02-11 22:03:58,932 DEBUG [M:0;jenkins-hbase9:39877] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 22:03:58,932 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153034474] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676153034474,5,FailOnTimeoutGroup] 2023-02-11 22:03:58,932 INFO [M:0;jenkins-hbase9:39877] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 22:03:58,933 INFO [M:0;jenkins-hbase9:39877] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 22:03:58,933 INFO [M:0;jenkins-hbase9:39877] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-11 22:03:58,933 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 22:03:58,933 DEBUG [M:0;jenkins-hbase9:39877] master.HMaster(1502): Stopping service threads 2023-02-11 22:03:58,933 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 22:03:58,933 INFO [M:0;jenkins-hbase9:39877] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 22:03:58,934 ERROR [M:0;jenkins-hbase9:39877] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 22:03:58,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 22:03:58,934 INFO [M:0;jenkins-hbase9:39877] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 22:03:58,934 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 22:03:58,934 DEBUG [M:0;jenkins-hbase9:39877] zookeeper.ZKUtil(398): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 22:03:58,934 WARN [M:0;jenkins-hbase9:39877] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 22:03:58,934 INFO [M:0;jenkins-hbase9:39877] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 22:03:58,935 INFO [M:0;jenkins-hbase9:39877] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 22:03:58,935 DEBUG [M:0;jenkins-hbase9:39877] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 22:03:58,935 INFO [M:0;jenkins-hbase9:39877] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:58,935 DEBUG [M:0;jenkins-hbase9:39877] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:58,935 DEBUG [M:0;jenkins-hbase9:39877] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 22:03:58,935 DEBUG [M:0;jenkins-hbase9:39877] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:58,935 INFO [M:0;jenkins-hbase9:39877] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.66 KB heapSize=65.63 KB 2023-02-11 22:03:58,942 INFO [M:0;jenkins-hbase9:39877] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.66 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e15bd012f801461283610ecedb44ebed 2023-02-11 22:03:58,945 DEBUG [M:0;jenkins-hbase9:39877] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e15bd012f801461283610ecedb44ebed as hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e15bd012f801461283610ecedb44ebed 2023-02-11 22:03:58,986 INFO [M:0;jenkins-hbase9:39877] regionserver.HStore(1080): Added hdfs://localhost:43029/user/jenkins/test-data/4b2c1c16-62db-672e-bab5-d1ae767858f8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e15bd012f801461283610ecedb44ebed, entries=17, sequenceid=132, filesize=8.6 K 2023-02-11 22:03:58,986 INFO [M:0;jenkins-hbase9:39877] regionserver.HRegion(2947): Finished flush of dataSize ~54.66 KB/55975, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 51ms, sequenceid=132, compaction requested=false 2023-02-11 22:03:58,987 INFO [M:0;jenkins-hbase9:39877] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 22:03:58,987 DEBUG [M:0;jenkins-hbase9:39877] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676153038935Disabling compacts and flushes for region at 1676153038935Disabling writes for close at 1676153038935Obtaining lock to block concurrent updates at 1676153038935Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676153038935Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=55975, getHeapSize=67184, getOffHeapSize=0, getCellsCount=145 at 1676153038935Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676153038936 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676153038936Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676153038938 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676153038938Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676153038982 (+44 ms)Finished flush of dataSize ~54.66 KB/55975, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 51ms, sequenceid=132, compaction requested=false at 1676153038987 (+5 ms)Writing region close event to WAL at 1676153038987Closed at 1676153038987 2023-02-11 22:03:58,989 INFO [M:0;jenkins-hbase9:39877] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 22:03:58,989 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 22:03:58,989 INFO [M:0;jenkins-hbase9:39877] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39877 2023-02-11 22:03:58,992 DEBUG [M:0;jenkins-hbase9:39877] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,39877,1676153034239 already deleted, retry=false 2023-02-11 22:03:59,098 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:59,098 INFO [M:0;jenkins-hbase9:39877] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,39877,1676153034239; zookeeper connection closed. 2023-02-11 22:03:59,098 ERROR [Listener at localhost/45895-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48509f77 rejected from java.util.concurrent.ThreadPoolExecutor@4c6f02a5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:59,099 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): master:39877-0x100456a75d30000, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:59,099 ERROR [Listener at localhost/45895-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74499c75 rejected from java.util.concurrent.ThreadPoolExecutor@4c6f02a5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:59,198 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:59,198 INFO [RS:0;jenkins-hbase9:39383] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,39383,1676153034304; zookeeper connection closed. 2023-02-11 22:03:59,199 ERROR [Listener at localhost/45895-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@99ca5b7 rejected from java.util.concurrent.ThreadPoolExecutor@72b0b06b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:59,199 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39383-0x100456a75d30001, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:59,199 ERROR [Listener at localhost/45895-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@710b0996 rejected from java.util.concurrent.ThreadPoolExecutor@72b0b06b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:59,199 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@678c41d6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@678c41d6 2023-02-11 22:03:59,299 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:59,299 INFO [RS:1;jenkins-hbase9:39967] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,39967,1676153034333; zookeeper connection closed. 2023-02-11 22:03:59,299 ERROR [Listener at localhost/45895-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4068f0e rejected from java.util.concurrent.ThreadPoolExecutor@2ec11909[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:59,299 DEBUG [Listener at localhost/45895-EventThread] zookeeper.ZKWatcher(600): regionserver:39967-0x100456a75d30002, quorum=127.0.0.1:64520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 22:03:59,299 ERROR [Listener at localhost/45895-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7ccd1eec rejected from java.util.concurrent.ThreadPoolExecutor@2ec11909[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 22:03:59,299 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@18acb0ad] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@18acb0ad 2023-02-11 22:03:59,299 INFO [Listener at localhost/45895] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 22:03:59,300 WARN [Listener at localhost/45895] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:59,308 INFO [Listener at localhost/45895] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:59,409 WARN [BP-1854518425-172.31.2.10-1676153033635 heartbeating to localhost/127.0.0.1:43029] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:59,409 WARN [BP-1854518425-172.31.2.10-1676153033635 heartbeating to localhost/127.0.0.1:43029] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1854518425-172.31.2.10-1676153033635 (Datanode Uuid fbeb9fa8-3f8a-492b-90f5-6421083676eb) service to localhost/127.0.0.1:43029 2023-02-11 22:03:59,410 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/cluster_53c08581-4388-9476-8765-3aee71e08e15/dfs/data/data3/current/BP-1854518425-172.31.2.10-1676153033635] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:59,410 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/cluster_53c08581-4388-9476-8765-3aee71e08e15/dfs/data/data4/current/BP-1854518425-172.31.2.10-1676153033635] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:59,411 WARN [Listener at localhost/45895] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 22:03:59,414 INFO [Listener at localhost/45895] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:59,515 WARN [BP-1854518425-172.31.2.10-1676153033635 heartbeating to localhost/127.0.0.1:43029] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 22:03:59,515 WARN [BP-1854518425-172.31.2.10-1676153033635 heartbeating to localhost/127.0.0.1:43029] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1854518425-172.31.2.10-1676153033635 (Datanode Uuid 0f6aeac3-f516-4a02-b679-f2c22a22caaf) service to localhost/127.0.0.1:43029 2023-02-11 22:03:59,516 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/cluster_53c08581-4388-9476-8765-3aee71e08e15/dfs/data/data1/current/BP-1854518425-172.31.2.10-1676153033635] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:59,516 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b64da29f-af1d-98bd-c316-db2ec345746c/cluster_53c08581-4388-9476-8765-3aee71e08e15/dfs/data/data2/current/BP-1854518425-172.31.2.10-1676153033635] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 22:03:59,526 INFO [Listener at localhost/45895] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 22:03:59,638 INFO [Listener at localhost/45895] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 22:03:59,654 INFO [Listener at localhost/45895] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 22:03:59,666 INFO [Listener at localhost/45895] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=292 (was 272) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:43029 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:43029 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45895 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:43029 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:43029 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43029 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:43029 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:43029 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,39877,1676153034239)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=597 (was 578) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=258 (was 271), ProcessCount=166 (was 166), AvailableMemoryMB=9453 (was 9578)